1324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver/* 2324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver [The "BSD license"] 3324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver Copyright (c) 2005-2011 Terence Parr 4324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver All rights reserved. 5324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 6324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver Grammar conversion to ANTLR v3: 7324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver Copyright (c) 2011 Sam Harwell 8324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver All rights reserved. 9324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 10324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver Redistribution and use in source and binary forms, with or without 11324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver modification, are permitted provided that the following conditions 12324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver are met: 13324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 1. Redistributions of source code must retain the above copyright 14324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver notice, this list of conditions and the following disclaimer. 15324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 2. Redistributions in binary form must reproduce the above copyright 16324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver notice, this list of conditions and the following disclaimer in the 17324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver documentation and/or other materials provided with the distribution. 18324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 3. The name of the author may not be used to endorse or promote products 19324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver derived from this software without specific prior written permission. 20324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 21324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver THIS SOFTWARE IS PROVIDED BY THE AUTHOR ``AS IS'' AND ANY EXPRESS OR 22324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES 23324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. 24324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, 25324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT 26324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, 27324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY 28324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT 29324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF 30324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. 31324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver*/ 32324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 33324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver/** [Warning: TJP says that this is probably out of date as of 11/19/2005, 34324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * but since it's probably still useful, I'll leave in. Don't have energy 35324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * to update at the moment.] 36324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 37324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * Compute the token types for all literals and rules etc.. There are 38324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * a few different cases to consider for grammar types and a few situations 39324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * within. 40324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 41324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * CASE 1 : pure parser grammar 42324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * a) Any reference to a token gets a token type. 43324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * b) The tokens section may alias a token name to a string or char 44324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 45324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * CASE 2 : pure lexer grammar 46324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * a) Import token vocabulary if available. Set token types for any new tokens 47324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * to values above last imported token type 48324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * b) token rule definitions get token types if not already defined 49324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * c) literals do NOT get token types 50324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 51324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * CASE 3 : merged parser / lexer grammar 52324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * a) Any char or string literal gets a token type in a parser rule 53324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * b) Any reference to a token gets a token type if not referencing 54324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * a fragment lexer rule 55324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * c) The tokens section may alias a token name to a string or char 56324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * which must add a rule to the lexer 57324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * d) token rule definitions get token types if not already defined 58324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * e) token rule definitions may also alias a token name to a literal. 59324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * E.g., Rule 'FOR : "for";' will alias FOR to "for" in the sense that 60324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * references to either in the parser grammar will yield the token type 61324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 62324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * What this pass does: 63324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 64324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 0. Collects basic info about the grammar like grammar name and type; 65324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * Oh, I have go get the options in case they affect the token types. 66324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * E.g., tokenVocab option. 67324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * Imports any token vocab name/type pairs into a local hashtable. 68324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 1. Finds a list of all literals and token names. 69324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 2. Finds a list of all token name rule definitions; 70324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * no token rules implies pure parser. 71324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 3. Finds a list of all simple token rule defs of form "<NAME> : <literal>;" 72324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * and aliases them. 73324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 4. Walks token names table and assign types to any unassigned 74324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 5. Walks aliases and assign types to referenced literals 75324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 6. Walks literals, assigning types if untyped 76324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * 4. Informs the Grammar object of the type definitions such as: 77324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * g.defineToken(<charliteral>, ttype); 78324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * g.defineToken(<stringliteral>, ttype); 79324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * g.defineToken(<tokenID>, ttype); 80324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * where some of the ttype values will be the same for aliases tokens. 81324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver */ 82324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruvertree grammar AssignTokenTypesWalker; 83324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 84324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruveroptions 85324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver{ 86324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver tokenVocab = ANTLR; 87324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ASTLabelType = GrammarAST; 88324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 89324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 90324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver@header { 91324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverpackage org.antlr.grammar.v3; 92324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 93324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverimport java.util.*; 94324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverimport org.antlr.analysis.*; 95324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverimport org.antlr.misc.*; 96324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverimport org.antlr.tool.*; 97324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 98324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverimport org.antlr.runtime.BitSet; 99324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 100324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 101324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver@members { 102324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected Grammar grammar; 103324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected String currentRuleName; 104324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 105324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected static GrammarAST stringAlias; 106324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected static GrammarAST charAlias; 107324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected static GrammarAST stringAlias2; 108324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected static GrammarAST charAlias2; 109324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 110324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver@Override 111324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverpublic void reportError(RecognitionException ex) 112324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver{ 113324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver Token token = null; 114324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver if (ex instanceof MismatchedTokenException) { 115324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver token = ((MismatchedTokenException)ex).token; 116324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } else if (ex instanceof NoViableAltException) { 117324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver token = ((NoViableAltException)ex).token; 118324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 119324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 120324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ErrorManager.syntaxError( 121324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ErrorManager.MSG_SYNTAX_ERROR, 122324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver grammar, 123324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver token, 124324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver "assign.types: " + ex.toString(), 125324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ex); 126324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 127324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 128324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void initASTPatterns() 129324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver{ 130324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver TreeAdaptor adaptor = new ANTLRParser.grammar_Adaptor(null); 131324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 132324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver /* 133324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * stringAlias = ^(BLOCK[] ^(ALT[] STRING_LITERAL[] EOA[]) EOB[]) 134324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver */ 135324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver stringAlias = (GrammarAST)adaptor.create( BLOCK, "BLOCK" ); 136324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 137324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver GrammarAST alt = (GrammarAST)adaptor.create( ALT, "ALT" ); 138324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( STRING_LITERAL, "STRING_LITERAL" ) ); 139324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( EOA, "EOA" ) ); 140324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( stringAlias, alt ); 141324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 142324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( stringAlias, adaptor.create( EOB, "EOB" ) ); 143324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 144324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver /* 145324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * charAlias = ^(BLOCK[] ^(ALT[] CHAR_LITERAL[] EOA[]) EOB[]) 146324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver */ 147324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver charAlias = (GrammarAST)adaptor.create( BLOCK, "BLOCK" ); 148324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 149324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver GrammarAST alt = (GrammarAST)adaptor.create( ALT, "ALT" ); 150324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( CHAR_LITERAL, "CHAR_LITERAL" ) ); 151324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( EOA, "EOA" ) ); 152324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( charAlias, alt ); 153324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 154324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( charAlias, adaptor.create( EOB, "EOB" ) ); 155324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 156324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver /* 157324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * stringAlias2 = ^(BLOCK[] ^(ALT[] STRING_LITERAL[] ACTION[] EOA[]) EOB[]) 158324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver */ 159324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver stringAlias2 = (GrammarAST)adaptor.create( BLOCK, "BLOCK" ); 160324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 161324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver GrammarAST alt = (GrammarAST)adaptor.create( ALT, "ALT" ); 162324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( STRING_LITERAL, "STRING_LITERAL" ) ); 163324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( ACTION, "ACTION" ) ); 164324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( EOA, "EOA" ) ); 165324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( stringAlias2, alt ); 166324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 167324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( stringAlias2, adaptor.create( EOB, "EOB" ) ); 168324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 169324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver /* 170324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver * charAlias = ^(BLOCK[] ^(ALT[] CHAR_LITERAL[] ACTION[] EOA[]) EOB[]) 171324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver */ 172324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver charAlias2 = (GrammarAST)adaptor.create( BLOCK, "BLOCK" ); 173324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 174324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver GrammarAST alt = (GrammarAST)adaptor.create( ALT, "ALT" ); 175324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( CHAR_LITERAL, "CHAR_LITERAL" ) ); 176324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( ACTION, "ACTION" ) ); 177324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( alt, adaptor.create( EOA, "EOA" ) ); 178324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( charAlias2, alt ); 179324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 180324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver adaptor.addChild( charAlias2, adaptor.create( EOB, "EOB" ) ); 181324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 182324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 183324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver// Behavior moved to AssignTokenTypesBehavior 184324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void trackString(GrammarAST t) {} 185324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void trackToken( GrammarAST t ) {} 186324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void trackTokenRule( GrammarAST t, GrammarAST modifier, GrammarAST block ) {} 187324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void alias( GrammarAST t, GrammarAST s ) {} 188324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverpublic void defineTokens( Grammar root ) {} 189324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void defineStringLiteralsFromDelegates() {} 190324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void assignStringTypes( Grammar root ) {} 191324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void aliasTokenIDsAndLiterals( Grammar root ) {} 192324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void assignTokenIDTypes( Grammar root ) {} 193324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void defineTokenNamesAndLiteralsInGrammar( Grammar root ) {} 194324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverprotected void init( Grammar root ) {} 195324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 196324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 197324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverpublic 198324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruvergrammar_[Grammar g] 199324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver@init 200324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver{ 201324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver if ( state.backtracking == 0 ) 202324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver init($g); 203324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 204324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ( ^( LEXER_GRAMMAR grammarSpec ) 205324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( PARSER_GRAMMAR grammarSpec ) 206324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( TREE_GRAMMAR grammarSpec ) 207324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( COMBINED_GRAMMAR grammarSpec ) 208324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ) 209324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 210324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 211324c4644fee44b9898524c09511bd33c3f12e2dfBen GruvergrammarSpec 212324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : id=ID 213324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (cmt=DOC_COMMENT)? 214324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (optionsSpec)? 215324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (delegateGrammars)? 216324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (tokensSpec)? 217324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (attrScope)* 218324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ( ^(AMPERSAND .*) )* // skip actions 219324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver rules 220324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 221324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 222324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverattrScope 223324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( 'scope' ID ( ^(AMPERSAND .*) )* ACTION ) 224324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 225324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 226324c4644fee44b9898524c09511bd33c3f12e2dfBen GruveroptionsSpec returns [Map<Object, Object> opts = new HashMap<Object, Object>()] 227324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( OPTIONS (option[$opts])+ ) 228324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 229324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 230324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruveroption[Map<Object, Object> opts] 231324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( ASSIGN ID optionValue ) 232324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 233324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver String key = $ID.text; 234324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver $opts.put(key, $optionValue.value); 235324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver // check for grammar-level option to import vocabulary 236324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver if ( currentRuleName==null && key.equals("tokenVocab") ) 237324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver { 238324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver grammar.importTokenVocabulary($ID,(String)$optionValue.value); 239324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 240324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver } 241324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 242324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 243324c4644fee44b9898524c09511bd33c3f12e2dfBen GruveroptionValue returns [Object value=null] 244324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver@init 245324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver{ 246324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver if ( state.backtracking == 0 ) 247324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver $value = $start.getText(); 248324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver} 249324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ID 250324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | STRING_LITERAL 251324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | CHAR_LITERAL 252324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | INT 253324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver {$value = Integer.parseInt($INT.text);} 254324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver// | cs=charSet {$value = $cs;} // return set AST in this case 255324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 256324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 257324c4644fee44b9898524c09511bd33c3f12e2dfBen GruvercharSet 258324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( CHARSET charSetElement ) 259324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 260324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 261324c4644fee44b9898524c09511bd33c3f12e2dfBen GruvercharSetElement 262324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : CHAR_LITERAL 263324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( OR CHAR_LITERAL CHAR_LITERAL ) 264324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( RANGE CHAR_LITERAL CHAR_LITERAL ) 265324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 266324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 267324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverdelegateGrammars 268324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( 'import' 269324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ( ^(ASSIGN ID ID) 270324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ID 271324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver )+ 272324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ) 273324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 274324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 275324c4644fee44b9898524c09511bd33c3f12e2dfBen GruvertokensSpec 276324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^(TOKENS tokenSpec*) 277324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 278324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 279324c4644fee44b9898524c09511bd33c3f12e2dfBen GruvertokenSpec 280324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : t=TOKEN_REF {trackToken($t);} 281324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( ASSIGN 282324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver t2=TOKEN_REF {trackToken($t2);} 283324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ( s=STRING_LITERAL {trackString($s); alias($t2,$s);} 284324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | c=CHAR_LITERAL {trackString($c); alias($t2,$c);} 285324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ) 286324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ) 287324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 288324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 289324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverrules 290324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : rule+ 291324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 292324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 293324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverrule 294324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^(RULE ruleBody) 295324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(PREC_RULE ruleBody) 296324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 297324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 298324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverruleBody 299324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : id=ID {currentRuleName=$id.text;} 300324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (m=modifier)? 301324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ^(ARG (ARG_ACTION)?) 302324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ^(RET (ARG_ACTION)?) 303324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (throwsSpec)? 304324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (optionsSpec)? 305324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (ruleScopeSpec)? 306324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ( ^(AMPERSAND .*) )* 307324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver b=block 308324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (exceptionGroup)? 309324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver EOR 310324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver {trackTokenRule($id,$m.start,$b.start);} 311324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 312324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 313324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruvermodifier 314324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : 'protected' 315324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | 'public' 316324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | 'private' 317324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | 'fragment' 318324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 319324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 320324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverthrowsSpec 321324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^('throws' ID+) 322324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 323324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 324324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverruleScopeSpec 325324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( 'scope' ( ^(AMPERSAND .*) )* (ACTION)? ( ID )* ) 326324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 327324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 328324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverblock 329324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( BLOCK 330324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver (optionsSpec)? 331324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ( alternative rewrite )+ 332324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver EOB 333324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ) 334324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 335324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 336324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruveralternative 337324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( ALT (element)+ EOA ) 338324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 339324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 340324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverexceptionGroup 341324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ( exceptionHandler )+ (finallyClause)? 342324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | finallyClause 343324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 344324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 345324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverexceptionHandler 346324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^('catch' ARG_ACTION ACTION) 347324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 348324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 349324c4644fee44b9898524c09511bd33c3f12e2dfBen GruverfinallyClause 350324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^('finally' ACTION) 351324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 352324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 353324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverrewrite 354324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^(REWRITES ( ^(REWRITE .*) )* ) 355324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | 356324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 357324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 358324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverelement 359324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^(ROOT element) 360324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(BANG element) 361324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | atom 362324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(NOT element) 363324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(RANGE atom atom) 364324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(CHAR_RANGE atom atom) 365324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(ASSIGN ID element) 366324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(PLUS_ASSIGN ID element) 367324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ebnf 368324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | tree_ 369324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( SYNPRED block ) 370324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | FORCED_ACTION 371324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ACTION 372324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | SEMPRED 373324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | SYN_SEMPRED 374324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(BACKTRACK_SEMPRED .*) 375324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | GATED_SEMPRED 376324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | EPSILON 377324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 378324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 379324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverebnf 380324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : block 381324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( OPTIONAL block ) 382324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( CLOSURE block ) 383324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( POSITIVE_CLOSURE block ) 384324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 385324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 386324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruvertree_ 387324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^(TREE_BEGIN element+) 388324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 389324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 390324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruveratom 391324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ^( RULE_REF (ARG_ACTION)? ) 392324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^( t=TOKEN_REF (ARG_ACTION )? ) {trackToken($t);} 393324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | c=CHAR_LITERAL {trackString($c);} 394324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | s=STRING_LITERAL {trackString($s);} 395324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | WILDCARD 396324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | ^(DOT ID atom) // scope override on rule 397324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 398324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver 399324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruverast_suffix 400324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver : ROOT 401324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver | BANG 402324c4644fee44b9898524c09511bd33c3f12e2dfBen Gruver ; 403