Skip site navigation (1)Skip section navigation (2)

  
 
  

home | help
XTOKID(1)			  User Commands 		       XTOKID(1)

NAME
     xtokid - Print all tokens found in a source file.

SYNOPSIS
     xtokid [OPTION]... [FILE]...

DESCRIPTION
     Print all tokens found in a source file.

     -i, --include=LANGS
	    include languages in LANGS (default: "C C++ asm")

     -x, --exclude=LANGS
	    exclude languages in LANGS

     -l, --lang-option=L:OPT pass OPT as a default for language L (see below)

     -m, --lang-map=MAPFILE
	    use MAPFILE to map file names onto source language

     -d, --default-lang=LANG
	    make LANG the default source language

     -p, --prune=NAMES
	    exclude the named files and/or directories

     --files0-from=F
	    tokenize only the files specified by NUL-terminated names in file F

     --help
	    display this help and exit --version	   output version infor-
	    mation and exit

     The following arguments apply to the language-specific scanners:

   C language:
     -k,--keep=CHARS
	    Allow CHARS in single-token strings, keep the result

     -i,--ignore=CHARS
	    Allow CHARS in single-token strings, toss the result

     -u,--strip-underscore
	    Strip a leading underscore from single-token strings

   C++ language:
     -k,--keep=CHARS
	    Allow CHARS in single-token strings, keep the result

     -i,--ignore=CHARS
	    Allow CHARS in single-token strings, toss the result

     -u,--strip-underscore
	    Strip a leading underscore from single-token strings

   Java language:
     -k,--keep=CHARS
	    Allow CHARS in single-token strings, keep the result

     -i,--ignore=CHARS
	    Allow CHARS in single-token strings, toss the result

     -u,--strip-underscore
	    Strip a leading underscore from single-token strings

   Assembly language:
     -c,--comment=CHARS
	    Any of CHARS starts a comment until end-of-line

     -k,--keep=CHARS
	    Allow CHARS in tokens, and keep the result

     -i,--ignore=CHARS
	    Allow CHARS in tokens, and toss the result

     -u,--strip-underscore
	    Strip a leading underscore from tokens

     -n,--no-cpp
	    Don't handle C pre-processor directives

   Text language:
     -i,--include=CHAR-CLASS
	    Treat characters of CHAR-CLASS as token constituents

     -x,--exclude=CHAR-CLASS
	    Treat characters of CHAR-CLASS as token delimiters

   Perl language:
     -i,--include=CHAR-CLASS
	    Treat characters of CHAR-CLASS as token constituents

     -x,--exclude=CHAR-CLASS
	    Treat characters of CHAR-CLASS as token delimiters

     -d,--dtags
	    Include documentation tags

     Lisp language:

REPORTING BUGS
     Report bugs to bug-idutils@gnu.org

SEE ALSO
     The  full	documentation  for xtokid is maintained as a Texinfo manual.  If
     the info and xtokid programs are properly installed at your site, the  com-
     mand

	    info xtokid

     should give you access to the complete manual.

xtokid - 4.6			  February 2012 		       XTOKID(1)

Want to link to this manual page? Use this URL:
<https://man.freebsd.org/cgi/man.cgi?query=xtokid&sektion=1&manpath=FreeBSD+Ports+15.1.quarterly>

home | help