trtokens 0.21.4

There is a newer version of this package available.
See the version list below for details.
dotnet tool install --global trtokens --version 0.21.4                
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest # if you are setting up this repo
dotnet tool install --local trtokens --version 0.21.4                
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=trtokens&version=0.21.4                
nuke :add-package trtokens --version 0.21.4                

trtokens

Summary

Print tokens in a parse tree

Description

The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.

Usage

trtokens

Examples

Input:

Assume the Arithmetic.g4 parser has been built.

Command:

trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens

Output:

Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]

[@8,8:8='3',<2>,1:8]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]

Current version

0.21.4 Fix trquery.

Product Compatible and additional computed target framework versions.
.NET net7.0 is compatible.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last updated
0.23.8 109 11/1/2024
0.23.7 2,540 10/9/2024
0.23.6 736 9/21/2024
0.23.5 109 9/15/2024
0.23.4 102 9/7/2024
0.23.3 127 8/15/2024
0.23.2 130 6/28/2024
0.23.1 121 6/22/2024
0.23.0 201 4/25/2024
0.22.0 246 2/26/2024
0.21.16 270 11/16/2023
0.21.15 215 11/16/2023
0.21.14 145 11/15/2023
0.21.13 180 11/14/2023
0.21.12 290 10/27/2023
0.21.11 307 10/24/2023
0.21.9 371 9/27/2023
0.21.8 260 9/26/2023
0.21.7 345 9/26/2023
0.21.6 232 9/20/2023
0.21.5 251 9/18/2023
0.21.4 232 9/17/2023
0.21.3 224 9/14/2023
0.21.2 233 9/4/2023
0.21.1 374 8/15/2023
0.21.0 276 6/25/2023
0.20.27 259 6/15/2023
0.20.26 246 6/5/2023
0.20.25 271 6/3/2023
0.20.24 192 6/1/2023
0.20.23 209 5/31/2023
0.20.22 215 5/21/2023
0.20.21 240 5/15/2023
0.20.20 214 5/11/2023
0.20.19 203 5/8/2023
0.20.18 265 5/8/2023
0.20.17 270 5/4/2023
0.20.16 230 5/1/2023
0.20.15 253 4/27/2023
0.20.14 303 4/21/2023
0.20.13 273 4/13/2023
0.20.12 364 3/17/2023
0.20.11 351 3/15/2023
0.20.10 338 3/15/2023
0.20.9 350 3/14/2023
0.20.8 327 3/14/2023
0.20.7 341 3/13/2023
0.20.6 376 3/11/2023
0.20.5 367 3/11/2023
0.20.4 334 3/9/2023
0.20.3 346 3/8/2023
0.20.2 329 3/7/2023
0.20.1 363 3/7/2023
0.20.0 411 2/22/2023
0.19.3 414 2/19/2023
0.19.2 413 2/2/2023
0.19.1 421 1/28/2023
0.19.0 453 1/15/2023
0.19.0-alpha7 388 1/15/2023
0.19.0-alpha6 262 1/14/2023
0.19.0-alpha5 296 1/12/2023
0.19.0-alpha4 323 1/11/2023
0.19.0-alpha3 405 1/5/2023
0.19.0-alpha2 318 1/4/2023
0.19.0-alpha1 329 1/4/2023
0.18.1 542 11/11/2022
0.18.0 447 11/7/2022
0.17.0 504 9/11/2022
0.16.5 580 7/29/2022
0.16.4 567 6/13/2022
0.16.3 609 5/7/2022
0.16.2 536 5/6/2022
0.16.1 552 5/5/2022
0.16.0 637 4/13/2022
0.15.1 622 4/4/2022
0.15.0 542 3/20/2022
0.14.3 615 2/27/2022
0.14.2 539 2/18/2022
0.14.1 534 1/26/2022
0.14.0 563 1/26/2022
0.13.8 571 1/14/2022
0.13.7 555 1/13/2022
0.13.6 576 1/13/2022
0.13.5 573 1/12/2022
0.13.4 568 1/11/2022
0.13.3 568 1/10/2022
0.13.2 378 12/24/2021
0.13.1 422 12/24/2021
0.13.0 437 12/23/2021
0.12.0 451 12/6/2021
0.11.5 507 10/17/2021
0.11.4 431 10/17/2021
0.11.3 417 9/28/2021
0.11.2 446 9/26/2021
0.11.1 488 9/25/2021
0.11.0 472 9/24/2021
0.10.0 477 9/9/2021
0.8.9 399 8/13/2021
0.8.8 409 8/5/2021
0.8.7 420 7/20/2021
0.8.6 435 7/13/2021
0.8.5 423 7/6/2021
0.8.4 404 6/24/2021
0.8.3 489 6/13/2021
0.8.2 481 6/8/2021
0.8.1 440 6/2/2021
0.8.0 511 5/27/2021
0.7.0 414 5/10/2021
0.6.0 427 5/3/2021
0.5.5 411 4/22/2021
0.5.0 442 4/14/2021

# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.21.4 Fix trquery.