Coverage for /pythoncovmergedfiles/medio/medio/usr/local/lib/python3.8/site-packages/pygments/lexers/modula2.py: 59%

1""" 

2 pygments.lexers.modula2 

3 ~~~~~~~~~~~~~~~~~~~~~~~ 

4 

5 Multi-Dialect Lexer for Modula-2. 

6 

7 :copyright: Copyright 2006-2023 by the Pygments team, see AUTHORS. 

8 :license: BSD, see LICENSE for details. 

9""" 

10 

11import re 

12 

13from pygments.lexer import RegexLexer, include 

14from pygments.util import get_bool_opt, get_list_opt 

15from pygments.token import Text, Comment, Operator, Keyword, Name, \ 

16 String, Number, Punctuation, Error 

17 

18__all__ = ['Modula2Lexer'] 

19 

20 

21# Multi-Dialect Modula-2 Lexer 

22class Modula2Lexer(RegexLexer): 

23 """ 

24 For Modula-2 source code. 

25 

26 The Modula-2 lexer supports several dialects. By default, it operates in 

27 fallback mode, recognising the *combined* literals, punctuation symbols 

28 and operators of all supported dialects, and the *combined* reserved words 

29 and builtins of PIM Modula-2, ISO Modula-2 and Modula-2 R10, while not 

30 differentiating between library defined identifiers. 

31 

32 To select a specific dialect, a dialect option may be passed 

33 or a dialect tag may be embedded into a source file. 

34 

35 Dialect Options: 

36 

37 `m2pim` 

38 Select PIM Modula-2 dialect. 

39 `m2iso` 

40 Select ISO Modula-2 dialect. 

41 `m2r10` 

42 Select Modula-2 R10 dialect. 

43 `objm2` 

44 Select Objective Modula-2 dialect. 

45 

46 The PIM and ISO dialect options may be qualified with a language extension. 

47 

48 Language Extensions: 

49 

50 `+aglet` 

51 Select Aglet Modula-2 extensions, available with m2iso. 

52 `+gm2` 

53 Select GNU Modula-2 extensions, available with m2pim. 

54 `+p1` 

55 Select p1 Modula-2 extensions, available with m2iso. 

56 `+xds` 

57 Select XDS Modula-2 extensions, available with m2iso. 

58 

59 

60 Passing a Dialect Option via Unix Commandline Interface 

61 

62 Dialect options may be passed to the lexer using the `dialect` key. 

63 Only one such option should be passed. If multiple dialect options are 

64 passed, the first valid option is used, any subsequent options are ignored. 

65 

66 Examples: 

67 

68 `$ pygmentize -O full,dialect=m2iso -f html -o /path/to/output /path/to/input` 

69 Use ISO dialect to render input to HTML output 

70 `$ pygmentize -O full,dialect=m2iso+p1 -f rtf -o /path/to/output /path/to/input` 

71 Use ISO dialect with p1 extensions to render input to RTF output 

72 

73 

74 Embedding a Dialect Option within a source file 

75 

76 A dialect option may be embedded in a source file in form of a dialect 

77 tag, a specially formatted comment that specifies a dialect option. 

78 

79 Dialect Tag EBNF:: 

80 

81 dialectTag : 

82 OpeningCommentDelim Prefix dialectOption ClosingCommentDelim ; 

83 

84 dialectOption : 

85 'm2pim' | 'm2iso' | 'm2r10' | 'objm2' | 

86 'm2iso+aglet' | 'm2pim+gm2' | 'm2iso+p1' | 'm2iso+xds' ; 

87 

88 Prefix : '!' ; 

89 

90 OpeningCommentDelim : '(*' ; 

91 

92 ClosingCommentDelim : '*)' ; 

93 

94 No whitespace is permitted between the tokens of a dialect tag. 

95 

96 In the event that a source file contains multiple dialect tags, the first 

97 tag that contains a valid dialect option will be used and any subsequent 

98 dialect tags will be ignored. Ideally, a dialect tag should be placed 

99 at the beginning of a source file. 

100 

101 An embedded dialect tag overrides a dialect option set via command line. 

102 

103 Examples: 

104 

105 ``(*!m2r10*) DEFINITION MODULE Foobar; ...`` 

106 Use Modula2 R10 dialect to render this source file. 

107 ``(*!m2pim+gm2*) DEFINITION MODULE Bazbam; ...`` 

108 Use PIM dialect with GNU extensions to render this source file. 

109 

110 

111 Algol Publication Mode: 

112 

113 In Algol publication mode, source text is rendered for publication of 

114 algorithms in scientific papers and academic texts, following the format 

115 of the Revised Algol-60 Language Report. It is activated by passing 

116 one of two corresponding styles as an option: 

117 

118 `algol` 

119 render reserved words lowercase underline boldface 

120 and builtins lowercase boldface italic 

121 `algol_nu` 

122 render reserved words lowercase boldface (no underlining) 

123 and builtins lowercase boldface italic 

124 

125 The lexer automatically performs the required lowercase conversion when 

126 this mode is activated. 

127 

128 Example: 

129 

130 ``$ pygmentize -O full,style=algol -f latex -o /path/to/output /path/to/input`` 

131 Render input file in Algol publication mode to LaTeX output. 

132 

133 

134 Rendering Mode of First Class ADT Identifiers: 

135 

136 The rendering of standard library first class ADT identifiers is controlled 

137 by option flag "treat_stdlib_adts_as_builtins". 

138 

139 When this option is turned on, standard library ADT identifiers are rendered 

140 as builtins. When it is turned off, they are rendered as ordinary library 

141 identifiers. 

142 

143 `treat_stdlib_adts_as_builtins` (default: On) 

144 

145 The option is useful for dialects that support ADTs as first class objects 

146 and provide ADTs in the standard library that would otherwise be built-in. 

147 

148 At present, only Modula-2 R10 supports library ADTs as first class objects 

149 and therefore, no ADT identifiers are defined for any other dialects. 

150 

151 Example: 

152 

153 ``$ pygmentize -O full,dialect=m2r10,treat_stdlib_adts_as_builtins=Off ...`` 

154 Render standard library ADTs as ordinary library types. 

155 

156 .. versionadded:: 1.3 

157 

158 .. versionchanged:: 2.1 

159 Added multi-dialect support. 

160 """ 

161 name = 'Modula-2' 

162 url = 'http://www.modula2.org/' 

163 aliases = ['modula2', 'm2'] 

164 filenames = ['*.def', '*.mod'] 

165 mimetypes = ['text/x-modula2'] 

166 

167 flags = re.MULTILINE | re.DOTALL 

168 

169 tokens = { 

170 'whitespace': [ 

171 (r'\n+', Text), # blank lines 

172 (r'\s+', Text), # whitespace 

173 ], 

174 'dialecttags': [ 

175 # PIM Dialect Tag 

176 (r'\(\*!m2pim\*\)', Comment.Special), 

177 # ISO Dialect Tag 

178 (r'\(\*!m2iso\*\)', Comment.Special), 

179 # M2R10 Dialect Tag 

180 (r'\(\*!m2r10\*\)', Comment.Special), 

181 # ObjM2 Dialect Tag 

182 (r'\(\*!objm2\*\)', Comment.Special), 

183 # Aglet Extensions Dialect Tag 

184 (r'\(\*!m2iso\+aglet\*\)', Comment.Special), 

185 # GNU Extensions Dialect Tag 

186 (r'\(\*!m2pim\+gm2\*\)', Comment.Special), 

187 # p1 Extensions Dialect Tag 

188 (r'\(\*!m2iso\+p1\*\)', Comment.Special), 

189 # XDS Extensions Dialect Tag 

190 (r'\(\*!m2iso\+xds\*\)', Comment.Special), 

191 ], 

192 'identifiers': [ 

193 (r'([a-zA-Z_$][\w$]*)', Name), 

194 ], 

195 'prefixed_number_literals': [ 

196 # 

197 # Base-2, whole number 

198 (r'0b[01]+(\'[01]+)*', Number.Bin), 

199 # 

200 # Base-16, whole number 

201 (r'0[ux][0-9A-F]+(\'[0-9A-F]+)*', Number.Hex), 

202 ], 

203 'plain_number_literals': [ 

204 # 

205 # Base-10, real number with exponent 

206 (r'[0-9]+(\'[0-9]+)*' # integral part 

207 r'\.[0-9]+(\'[0-9]+)*' # fractional part 

208 r'[eE][+-]?[0-9]+(\'[0-9]+)*', # exponent 

209 Number.Float), 

210 # 

211 # Base-10, real number without exponent 

212 (r'[0-9]+(\'[0-9]+)*' # integral part 

213 r'\.[0-9]+(\'[0-9]+)*', # fractional part 

214 Number.Float), 

215 # 

216 # Base-10, whole number 

217 (r'[0-9]+(\'[0-9]+)*', Number.Integer), 

218 ], 

219 'suffixed_number_literals': [ 

220 # 

221 # Base-8, whole number 

222 (r'[0-7]+B', Number.Oct), 

223 # 

224 # Base-8, character code 

225 (r'[0-7]+C', Number.Oct), 

226 # 

227 # Base-16, number 

228 (r'[0-9A-F]+H', Number.Hex), 

229 ], 

230 'string_literals': [ 

231 (r'"(\\\\|\\[^\\]|[^"\\])*"', String.Double), 

232 (r"'(\\\\|\\[^\\]|[^'\\])*'", String.Single), 

233 ], 

234 'digraph_operators': [ 

235 # Dot Product Operator 

236 (r'\*\.', Operator), 

237 # Array Concatenation Operator 

238 (r'\+>', Operator), # M2R10 + ObjM2 

239 # Inequality Operator 

240 (r'<>', Operator), # ISO + PIM 

241 # Less-Or-Equal, Subset 

242 (r'<=', Operator), 

243 # Greater-Or-Equal, Superset 

244 (r'>=', Operator), 

245 # Identity Operator 

246 (r'==', Operator), # M2R10 + ObjM2 

247 # Type Conversion Operator 

248 (r'::', Operator), # M2R10 + ObjM2 

249 # Assignment Symbol 

250 (r':=', Operator), 

251 # Postfix Increment Mutator 

252 (r'\+\+', Operator), # M2R10 + ObjM2 

253 # Postfix Decrement Mutator 

254 (r'--', Operator), # M2R10 + ObjM2 

255 ], 

256 'unigraph_operators': [ 

257 # Arithmetic Operators 

258 (r'[+-]', Operator), 

259 (r'[*/]', Operator), 

260 # ISO 80000-2 compliant Set Difference Operator 

261 (r'\\', Operator), # M2R10 + ObjM2 

262 # Relational Operators 

263 (r'[=#<>]', Operator), 

264 # Dereferencing Operator 

265 (r'\^', Operator), 

266 # Dereferencing Operator Synonym 

267 (r'@', Operator), # ISO 

268 # Logical AND Operator Synonym 

269 (r'&', Operator), # PIM + ISO 

270 # Logical NOT Operator Synonym 

271 (r'~', Operator), # PIM + ISO 

272 # Smalltalk Message Prefix 

273 (r'`', Operator), # ObjM2 

274 ], 

275 'digraph_punctuation': [ 

276 # Range Constructor 

277 (r'\.\.', Punctuation), 

278 # Opening Chevron Bracket 

279 (r'<<', Punctuation), # M2R10 + ISO 

280 # Closing Chevron Bracket 

281 (r'>>', Punctuation), # M2R10 + ISO 

282 # Blueprint Punctuation 

283 (r'->', Punctuation), # M2R10 + ISO 

284 # Distinguish |# and # in M2 R10 

285 (r'\|#', Punctuation), 

286 # Distinguish ## and # in M2 R10 

287 (r'##', Punctuation), 

288 # Distinguish |* and * in M2 R10 

289 (r'\|\*', Punctuation), 

290 ], 

291 'unigraph_punctuation': [ 

292 # Common Punctuation 

293 (r'[()\[\]{},.:;|]', Punctuation), 

294 # Case Label Separator Synonym 

295 (r'!', Punctuation), # ISO 

296 # Blueprint Punctuation 

297 (r'\?', Punctuation), # M2R10 + ObjM2 

298 ], 

299 'comments': [ 

300 # Single Line Comment 

301 (r'^//.*?\n', Comment.Single), # M2R10 + ObjM2 

302 # Block Comment 

303 (r'\(\*([^$].*?)\*\)', Comment.Multiline), 

304 # Template Block Comment 

305 (r'/\*(.*?)\*/', Comment.Multiline), # M2R10 + ObjM2 

306 ], 

307 'pragmas': [ 

308 # ISO Style Pragmas 

309 (r'<\*.*?\*>', Comment.Preproc), # ISO, M2R10 + ObjM2 

310 # Pascal Style Pragmas 

311 (r'\(\*\$.*?\*\)', Comment.Preproc), # PIM 

312 ], 

313 'root': [ 

314 include('whitespace'), 

315 include('dialecttags'), 

316 include('pragmas'), 

317 include('comments'), 

318 include('identifiers'), 

319 include('suffixed_number_literals'), # PIM + ISO 

320 include('prefixed_number_literals'), # M2R10 + ObjM2 

321 include('plain_number_literals'), 

322 include('string_literals'), 

323 include('digraph_punctuation'), 

324 include('digraph_operators'), 

325 include('unigraph_punctuation'), 

326 include('unigraph_operators'), 

327 ] 

328 } 

329 

330# C o m m o n D a t a s e t s 

331 

332 # Common Reserved Words Dataset 

333 common_reserved_words = ( 

334 # 37 common reserved words 

335 'AND', 'ARRAY', 'BEGIN', 'BY', 'CASE', 'CONST', 'DEFINITION', 'DIV', 

336 'DO', 'ELSE', 'ELSIF', 'END', 'EXIT', 'FOR', 'FROM', 'IF', 

337 'IMPLEMENTATION', 'IMPORT', 'IN', 'LOOP', 'MOD', 'MODULE', 'NOT', 

338 'OF', 'OR', 'POINTER', 'PROCEDURE', 'RECORD', 'REPEAT', 'RETURN', 

339 'SET', 'THEN', 'TO', 'TYPE', 'UNTIL', 'VAR', 'WHILE', 

340 ) 

341 

342 # Common Builtins Dataset 

343 common_builtins = ( 

344 # 16 common builtins 

345 'ABS', 'BOOLEAN', 'CARDINAL', 'CHAR', 'CHR', 'FALSE', 'INTEGER', 

346 'LONGINT', 'LONGREAL', 'MAX', 'MIN', 'NIL', 'ODD', 'ORD', 'REAL', 

347 'TRUE', 

348 ) 

349 

350 # Common Pseudo-Module Builtins Dataset 

351 common_pseudo_builtins = ( 

352 # 4 common pseudo builtins 

353 'ADDRESS', 'BYTE', 'WORD', 'ADR' 

354 ) 

355 

356# P I M M o d u l a - 2 D a t a s e t s 

357 

358 # Lexemes to Mark as Error Tokens for PIM Modula-2 

359 pim_lexemes_to_reject = ( 

360 '!', '`', '@', '$', '%', '?', '\\', '==', '++', '--', '::', '*.', 

361 '+>', '->', '<<', '>>', '|#', '##', 

362 ) 

363 

364 # PIM Modula-2 Additional Reserved Words Dataset 

365 pim_additional_reserved_words = ( 

366 # 3 additional reserved words 

367 'EXPORT', 'QUALIFIED', 'WITH', 

368 ) 

369 

370 # PIM Modula-2 Additional Builtins Dataset 

371 pim_additional_builtins = ( 

372 # 16 additional builtins 

373 'BITSET', 'CAP', 'DEC', 'DISPOSE', 'EXCL', 'FLOAT', 'HALT', 'HIGH', 

374 'INC', 'INCL', 'NEW', 'NIL', 'PROC', 'SIZE', 'TRUNC', 'VAL', 

375 ) 

376 

377 # PIM Modula-2 Additional Pseudo-Module Builtins Dataset 

378 pim_additional_pseudo_builtins = ( 

379 # 5 additional pseudo builtins 

380 'SYSTEM', 'PROCESS', 'TSIZE', 'NEWPROCESS', 'TRANSFER', 

381 ) 

382 

383# I S O M o d u l a - 2 D a t a s e t s 

384 

385 # Lexemes to Mark as Error Tokens for ISO Modula-2 

386 iso_lexemes_to_reject = ( 

387 '`', '$', '%', '?', '\\', '==', '++', '--', '::', '*.', '+>', '->', 

388 '<<', '>>', '|#', '##', 

389 ) 

390 

391 # ISO Modula-2 Additional Reserved Words Dataset 

392 iso_additional_reserved_words = ( 

393 # 9 additional reserved words (ISO 10514-1) 

394 'EXCEPT', 'EXPORT', 'FINALLY', 'FORWARD', 'PACKEDSET', 'QUALIFIED', 

395 'REM', 'RETRY', 'WITH', 

396 # 10 additional reserved words (ISO 10514-2 & ISO 10514-3) 

397 'ABSTRACT', 'AS', 'CLASS', 'GUARD', 'INHERIT', 'OVERRIDE', 'READONLY', 

398 'REVEAL', 'TRACED', 'UNSAFEGUARDED', 

399 ) 

400 

401 # ISO Modula-2 Additional Builtins Dataset 

402 iso_additional_builtins = ( 

403 # 26 additional builtins (ISO 10514-1) 

404 'BITSET', 'CAP', 'CMPLX', 'COMPLEX', 'DEC', 'DISPOSE', 'EXCL', 'FLOAT', 

405 'HALT', 'HIGH', 'IM', 'INC', 'INCL', 'INT', 'INTERRUPTIBLE', 'LENGTH', 

406 'LFLOAT', 'LONGCOMPLEX', 'NEW', 'PROC', 'PROTECTION', 'RE', 'SIZE', 

407 'TRUNC', 'UNINTERRUBTIBLE', 'VAL', 

408 # 5 additional builtins (ISO 10514-2 & ISO 10514-3) 

409 'CREATE', 'DESTROY', 'EMPTY', 'ISMEMBER', 'SELF', 

410 ) 

411 

412 # ISO Modula-2 Additional Pseudo-Module Builtins Dataset 

413 iso_additional_pseudo_builtins = ( 

414 # 14 additional builtins (SYSTEM) 

415 'SYSTEM', 'BITSPERLOC', 'LOCSPERBYTE', 'LOCSPERWORD', 'LOC', 

416 'ADDADR', 'SUBADR', 'DIFADR', 'MAKEADR', 'ADR', 

417 'ROTATE', 'SHIFT', 'CAST', 'TSIZE', 

418 # 13 additional builtins (COROUTINES) 

419 'COROUTINES', 'ATTACH', 'COROUTINE', 'CURRENT', 'DETACH', 'HANDLER', 

420 'INTERRUPTSOURCE', 'IOTRANSFER', 'IsATTACHED', 'LISTEN', 

421 'NEWCOROUTINE', 'PROT', 'TRANSFER', 

422 # 9 additional builtins (EXCEPTIONS) 

423 'EXCEPTIONS', 'AllocateSource', 'CurrentNumber', 'ExceptionNumber', 

424 'ExceptionSource', 'GetMessage', 'IsCurrentSource', 

425 'IsExceptionalExecution', 'RAISE', 

426 # 3 additional builtins (TERMINATION) 

427 'TERMINATION', 'IsTerminating', 'HasHalted', 

428 # 4 additional builtins (M2EXCEPTION) 

429 'M2EXCEPTION', 'M2Exceptions', 'M2Exception', 'IsM2Exception', 

430 'indexException', 'rangeException', 'caseSelectException', 

431 'invalidLocation', 'functionException', 'wholeValueException', 

432 'wholeDivException', 'realValueException', 'realDivException', 

433 'complexValueException', 'complexDivException', 'protException', 

434 'sysException', 'coException', 'exException', 

435 ) 

436 

437# M o d u l a - 2 R 1 0 D a t a s e t s 

438 

439 # Lexemes to Mark as Error Tokens for Modula-2 R10 

440 m2r10_lexemes_to_reject = ( 

441 '!', '`', '@', '$', '%', '&', '<>', 

442 ) 

443 

444 # Modula-2 R10 reserved words in addition to the common set 

445 m2r10_additional_reserved_words = ( 

446 # 12 additional reserved words 

447 'ALIAS', 'ARGLIST', 'BLUEPRINT', 'COPY', 'GENLIB', 'INDETERMINATE', 

448 'NEW', 'NONE', 'OPAQUE', 'REFERENTIAL', 'RELEASE', 'RETAIN', 

449 # 2 additional reserved words with symbolic assembly option 

450 'ASM', 'REG', 

451 ) 

452 

453 # Modula-2 R10 builtins in addition to the common set 

454 m2r10_additional_builtins = ( 

455 # 26 additional builtins 

456 'CARDINAL', 'COUNT', 'EMPTY', 'EXISTS', 'INSERT', 'LENGTH', 'LONGCARD', 

457 'OCTET', 'PTR', 'PRED', 'READ', 'READNEW', 'REMOVE', 'RETRIEVE', 'SORT', 

458 'STORE', 'SUBSET', 'SUCC', 'TLIMIT', 'TMAX', 'TMIN', 'TRUE', 'TSIZE', 

459 'UNICHAR', 'WRITE', 'WRITEF', 

460 ) 

461 

462 # Modula-2 R10 Additional Pseudo-Module Builtins Dataset 

463 m2r10_additional_pseudo_builtins = ( 

464 # 13 additional builtins (TPROPERTIES) 

465 'TPROPERTIES', 'PROPERTY', 'LITERAL', 'TPROPERTY', 'TLITERAL', 

466 'TBUILTIN', 'TDYN', 'TREFC', 'TNIL', 'TBASE', 'TPRECISION', 

467 'TMAXEXP', 'TMINEXP', 

468 # 4 additional builtins (CONVERSION) 

469 'CONVERSION', 'TSXFSIZE', 'SXF', 'VAL', 

470 # 35 additional builtins (UNSAFE) 

471 'UNSAFE', 'CAST', 'INTRINSIC', 'AVAIL', 'ADD', 'SUB', 'ADDC', 'SUBC', 

472 'FETCHADD', 'FETCHSUB', 'SHL', 'SHR', 'ASHR', 'ROTL', 'ROTR', 'ROTLC', 

473 'ROTRC', 'BWNOT', 'BWAND', 'BWOR', 'BWXOR', 'BWNAND', 'BWNOR', 

474 'SETBIT', 'TESTBIT', 'LSBIT', 'MSBIT', 'CSBITS', 'BAIL', 'HALT', 

475 'TODO', 'FFI', 'ADDR', 'VARGLIST', 'VARGC', 

476 # 11 additional builtins (ATOMIC) 

477 'ATOMIC', 'INTRINSIC', 'AVAIL', 'SWAP', 'CAS', 'INC', 'DEC', 'BWAND', 

478 'BWNAND', 'BWOR', 'BWXOR', 

479 # 7 additional builtins (COMPILER) 

480 'COMPILER', 'DEBUG', 'MODNAME', 'PROCNAME', 'LINENUM', 'DEFAULT', 

481 'HASH', 

482 # 5 additional builtins (ASSEMBLER) 

483 'ASSEMBLER', 'REGISTER', 'SETREG', 'GETREG', 'CODE', 

484 ) 

485 

486# O b j e c t i v e M o d u l a - 2 D a t a s e t s 

487 

488 # Lexemes to Mark as Error Tokens for Objective Modula-2 

489 objm2_lexemes_to_reject = ( 

490 '!', '$', '%', '&', '<>', 

491 ) 

492 

493 # Objective Modula-2 Extensions 

494 # reserved words in addition to Modula-2 R10 

495 objm2_additional_reserved_words = ( 

496 # 16 additional reserved words 

497 'BYCOPY', 'BYREF', 'CLASS', 'CONTINUE', 'CRITICAL', 'INOUT', 'METHOD', 

498 'ON', 'OPTIONAL', 'OUT', 'PRIVATE', 'PROTECTED', 'PROTOCOL', 'PUBLIC', 

499 'SUPER', 'TRY', 

500 ) 

501 

502 # Objective Modula-2 Extensions 

503 # builtins in addition to Modula-2 R10 

504 objm2_additional_builtins = ( 

505 # 3 additional builtins 

506 'OBJECT', 'NO', 'YES', 

507 ) 

508 

509 # Objective Modula-2 Extensions 

510 # pseudo-module builtins in addition to Modula-2 R10 

511 objm2_additional_pseudo_builtins = ( 

512 # None 

513 ) 

514 

515# A g l e t M o d u l a - 2 D a t a s e t s 

516 

517 # Aglet Extensions 

518 # reserved words in addition to ISO Modula-2 

519 aglet_additional_reserved_words = ( 

520 # None 

521 ) 

522 

523 # Aglet Extensions 

524 # builtins in addition to ISO Modula-2 

525 aglet_additional_builtins = ( 

526 # 9 additional builtins 

527 'BITSET8', 'BITSET16', 'BITSET32', 'CARDINAL8', 'CARDINAL16', 

528 'CARDINAL32', 'INTEGER8', 'INTEGER16', 'INTEGER32', 

529 ) 

530 

531 # Aglet Modula-2 Extensions 

532 # pseudo-module builtins in addition to ISO Modula-2 

533 aglet_additional_pseudo_builtins = ( 

534 # None 

535 ) 

536 

537# G N U M o d u l a - 2 D a t a s e t s 

538 

539 # GNU Extensions 

540 # reserved words in addition to PIM Modula-2 

541 gm2_additional_reserved_words = ( 

542 # 10 additional reserved words 

543 'ASM', '__ATTRIBUTE__', '__BUILTIN__', '__COLUMN__', '__DATE__', 

544 '__FILE__', '__FUNCTION__', '__LINE__', '__MODULE__', 'VOLATILE', 

545 ) 

546 

547 # GNU Extensions 

548 # builtins in addition to PIM Modula-2 

549 gm2_additional_builtins = ( 

550 # 21 additional builtins 

551 'BITSET8', 'BITSET16', 'BITSET32', 'CARDINAL8', 'CARDINAL16', 

552 'CARDINAL32', 'CARDINAL64', 'COMPLEX32', 'COMPLEX64', 'COMPLEX96', 

553 'COMPLEX128', 'INTEGER8', 'INTEGER16', 'INTEGER32', 'INTEGER64', 

554 'REAL8', 'REAL16', 'REAL32', 'REAL96', 'REAL128', 'THROW', 

555 ) 

556 

557 # GNU Extensions 

558 # pseudo-module builtins in addition to PIM Modula-2 

559 gm2_additional_pseudo_builtins = ( 

560 # None 

561 ) 

562 

563# p 1 M o d u l a - 2 D a t a s e t s 

564 

565 # p1 Extensions 

566 # reserved words in addition to ISO Modula-2 

567 p1_additional_reserved_words = ( 

568 # None 

569 ) 

570 

571 # p1 Extensions 

572 # builtins in addition to ISO Modula-2 

573 p1_additional_builtins = ( 

574 # None 

575 ) 

576 

577 # p1 Modula-2 Extensions 

578 # pseudo-module builtins in addition to ISO Modula-2 

579 p1_additional_pseudo_builtins = ( 

580 # 1 additional builtin 

581 'BCD', 

582 ) 

583 

584# X D S M o d u l a - 2 D a t a s e t s 

585 

586 # XDS Extensions 

587 # reserved words in addition to ISO Modula-2 

588 xds_additional_reserved_words = ( 

589 # 1 additional reserved word 

590 'SEQ', 

591 ) 

592 

593 # XDS Extensions 

594 # builtins in addition to ISO Modula-2 

595 xds_additional_builtins = ( 

596 # 9 additional builtins 

597 'ASH', 'ASSERT', 'DIFFADR_TYPE', 'ENTIER', 'INDEX', 'LEN', 

598 'LONGCARD', 'SHORTCARD', 'SHORTINT', 

599 ) 

600 

601 # XDS Modula-2 Extensions 

602 # pseudo-module builtins in addition to ISO Modula-2 

603 xds_additional_pseudo_builtins = ( 

604 # 22 additional builtins (SYSTEM) 

605 'PROCESS', 'NEWPROCESS', 'BOOL8', 'BOOL16', 'BOOL32', 'CARD8', 

606 'CARD16', 'CARD32', 'INT8', 'INT16', 'INT32', 'REF', 'MOVE', 

607 'FILL', 'GET', 'PUT', 'CC', 'int', 'unsigned', 'size_t', 'void' 

608 # 3 additional builtins (COMPILER) 

609 'COMPILER', 'OPTION', 'EQUATION' 

610 ) 

611 

612# P I M S t a n d a r d L i b r a r y D a t a s e t s 

613 

614 # PIM Modula-2 Standard Library Modules Dataset 

615 pim_stdlib_module_identifiers = ( 

616 'Terminal', 'FileSystem', 'InOut', 'RealInOut', 'MathLib0', 'Storage', 

617 ) 

618 

619 # PIM Modula-2 Standard Library Types Dataset 

620 pim_stdlib_type_identifiers = ( 

621 'Flag', 'FlagSet', 'Response', 'Command', 'Lock', 'Permission', 

622 'MediumType', 'File', 'FileProc', 'DirectoryProc', 'FileCommand', 

623 'DirectoryCommand', 

624 ) 

625 

626 # PIM Modula-2 Standard Library Procedures Dataset 

627 pim_stdlib_proc_identifiers = ( 

628 'Read', 'BusyRead', 'ReadAgain', 'Write', 'WriteString', 'WriteLn', 

629 'Create', 'Lookup', 'Close', 'Delete', 'Rename', 'SetRead', 'SetWrite', 

630 'SetModify', 'SetOpen', 'Doio', 'SetPos', 'GetPos', 'Length', 'Reset', 

631 'Again', 'ReadWord', 'WriteWord', 'ReadChar', 'WriteChar', 

632 'CreateMedium', 'DeleteMedium', 'AssignName', 'DeassignName', 

633 'ReadMedium', 'LookupMedium', 'OpenInput', 'OpenOutput', 'CloseInput', 

634 'CloseOutput', 'ReadString', 'ReadInt', 'ReadCard', 'ReadWrd', 

635 'WriteInt', 'WriteCard', 'WriteOct', 'WriteHex', 'WriteWrd', 

636 'ReadReal', 'WriteReal', 'WriteFixPt', 'WriteRealOct', 'sqrt', 'exp', 

637 'ln', 'sin', 'cos', 'arctan', 'entier', 'ALLOCATE', 'DEALLOCATE', 

638 ) 

639 

640 # PIM Modula-2 Standard Library Variables Dataset 

641 pim_stdlib_var_identifiers = ( 

642 'Done', 'termCH', 'in', 'out' 

643 ) 

644 

645 # PIM Modula-2 Standard Library Constants Dataset 

646 pim_stdlib_const_identifiers = ( 

647 'EOL', 

648 ) 

649 

650# I S O S t a n d a r d L i b r a r y D a t a s e t s 

651 

652 # ISO Modula-2 Standard Library Modules Dataset 

653 iso_stdlib_module_identifiers = ( 

654 # TO DO 

655 ) 

656 

657 # ISO Modula-2 Standard Library Types Dataset 

658 iso_stdlib_type_identifiers = ( 

659 # TO DO 

660 ) 

661 

662 # ISO Modula-2 Standard Library Procedures Dataset 

663 iso_stdlib_proc_identifiers = ( 

664 # TO DO 

665 ) 

666 

667 # ISO Modula-2 Standard Library Variables Dataset 

668 iso_stdlib_var_identifiers = ( 

669 # TO DO 

670 ) 

671 

672 # ISO Modula-2 Standard Library Constants Dataset 

673 iso_stdlib_const_identifiers = ( 

674 # TO DO 

675 ) 

676 

677# M 2 R 1 0 S t a n d a r d L i b r a r y D a t a s e t s 

678 

679 # Modula-2 R10 Standard Library ADTs Dataset 

680 m2r10_stdlib_adt_identifiers = ( 

681 'BCD', 'LONGBCD', 'BITSET', 'SHORTBITSET', 'LONGBITSET', 

682 'LONGLONGBITSET', 'COMPLEX', 'LONGCOMPLEX', 'SHORTCARD', 'LONGLONGCARD', 

683 'SHORTINT', 'LONGLONGINT', 'POSINT', 'SHORTPOSINT', 'LONGPOSINT', 

684 'LONGLONGPOSINT', 'BITSET8', 'BITSET16', 'BITSET32', 'BITSET64', 

685 'BITSET128', 'BS8', 'BS16', 'BS32', 'BS64', 'BS128', 'CARDINAL8', 

686 'CARDINAL16', 'CARDINAL32', 'CARDINAL64', 'CARDINAL128', 'CARD8', 

687 'CARD16', 'CARD32', 'CARD64', 'CARD128', 'INTEGER8', 'INTEGER16', 

688 'INTEGER32', 'INTEGER64', 'INTEGER128', 'INT8', 'INT16', 'INT32', 

689 'INT64', 'INT128', 'STRING', 'UNISTRING', 

690 ) 

691 

692 # Modula-2 R10 Standard Library Blueprints Dataset 

693 m2r10_stdlib_blueprint_identifiers = ( 

694 'ProtoRoot', 'ProtoComputational', 'ProtoNumeric', 'ProtoScalar', 

695 'ProtoNonScalar', 'ProtoCardinal', 'ProtoInteger', 'ProtoReal', 

696 'ProtoComplex', 'ProtoVector', 'ProtoTuple', 'ProtoCompArray', 

697 'ProtoCollection', 'ProtoStaticArray', 'ProtoStaticSet', 

698 'ProtoStaticString', 'ProtoArray', 'ProtoString', 'ProtoSet', 

699 'ProtoMultiSet', 'ProtoDictionary', 'ProtoMultiDict', 'ProtoExtension', 

700 'ProtoIO', 'ProtoCardMath', 'ProtoIntMath', 'ProtoRealMath', 

701 ) 

702 

703 # Modula-2 R10 Standard Library Modules Dataset 

704 m2r10_stdlib_module_identifiers = ( 

705 'ASCII', 'BooleanIO', 'CharIO', 'UnicharIO', 'OctetIO', 

706 'CardinalIO', 'LongCardIO', 'IntegerIO', 'LongIntIO', 'RealIO', 

707 'LongRealIO', 'BCDIO', 'LongBCDIO', 'CardMath', 'LongCardMath', 

708 'IntMath', 'LongIntMath', 'RealMath', 'LongRealMath', 'BCDMath', 

709 'LongBCDMath', 'FileIO', 'FileSystem', 'Storage', 'IOSupport', 

710 ) 

711 

712 # Modula-2 R10 Standard Library Types Dataset 

713 m2r10_stdlib_type_identifiers = ( 

714 'File', 'Status', 

715 # TO BE COMPLETED 

716 ) 

717 

718 # Modula-2 R10 Standard Library Procedures Dataset 

719 m2r10_stdlib_proc_identifiers = ( 

720 'ALLOCATE', 'DEALLOCATE', 'SIZE', 

721 # TO BE COMPLETED 

722 ) 

723 

724 # Modula-2 R10 Standard Library Variables Dataset 

725 m2r10_stdlib_var_identifiers = ( 

726 'stdIn', 'stdOut', 'stdErr', 

727 ) 

728 

729 # Modula-2 R10 Standard Library Constants Dataset 

730 m2r10_stdlib_const_identifiers = ( 

731 'pi', 'tau', 

732 ) 

733 

734# D i a l e c t s 

735 

736 # Dialect modes 

737 dialects = ( 

738 'unknown', 

739 'm2pim', 'm2iso', 'm2r10', 'objm2', 

740 'm2iso+aglet', 'm2pim+gm2', 'm2iso+p1', 'm2iso+xds', 

741 ) 

742 

743# D a t a b a s e s 

744 

745 # Lexemes to Mark as Errors Database 

746 lexemes_to_reject_db = { 

747 # Lexemes to reject for unknown dialect 

748 'unknown': ( 

749 # LEAVE THIS EMPTY 

750 ), 

751 # Lexemes to reject for PIM Modula-2 

752 'm2pim': ( 

753 pim_lexemes_to_reject, 

754 ), 

755 # Lexemes to reject for ISO Modula-2 

756 'm2iso': ( 

757 iso_lexemes_to_reject, 

758 ), 

759 # Lexemes to reject for Modula-2 R10 

760 'm2r10': ( 

761 m2r10_lexemes_to_reject, 

762 ), 

763 # Lexemes to reject for Objective Modula-2 

764 'objm2': ( 

765 objm2_lexemes_to_reject, 

766 ), 

767 # Lexemes to reject for Aglet Modula-2 

768 'm2iso+aglet': ( 

769 iso_lexemes_to_reject, 

770 ), 

771 # Lexemes to reject for GNU Modula-2 

772 'm2pim+gm2': ( 

773 pim_lexemes_to_reject, 

774 ), 

775 # Lexemes to reject for p1 Modula-2 

776 'm2iso+p1': ( 

777 iso_lexemes_to_reject, 

778 ), 

779 # Lexemes to reject for XDS Modula-2 

780 'm2iso+xds': ( 

781 iso_lexemes_to_reject, 

782 ), 

783 } 

784 

785 # Reserved Words Database 

786 reserved_words_db = { 

787 # Reserved words for unknown dialect 

788 'unknown': ( 

789 common_reserved_words, 

790 pim_additional_reserved_words, 

791 iso_additional_reserved_words, 

792 m2r10_additional_reserved_words, 

793 ), 

794 

795 # Reserved words for PIM Modula-2 

796 'm2pim': ( 

797 common_reserved_words, 

798 pim_additional_reserved_words, 

799 ), 

800 

801 # Reserved words for Modula-2 R10 

802 'm2iso': ( 

803 common_reserved_words, 

804 iso_additional_reserved_words, 

805 ), 

806 

807 # Reserved words for ISO Modula-2 

808 'm2r10': ( 

809 common_reserved_words, 

810 m2r10_additional_reserved_words, 

811 ), 

812 

813 # Reserved words for Objective Modula-2 

814 'objm2': ( 

815 common_reserved_words, 

816 m2r10_additional_reserved_words, 

817 objm2_additional_reserved_words, 

818 ), 

819 

820 # Reserved words for Aglet Modula-2 Extensions 

821 'm2iso+aglet': ( 

822 common_reserved_words, 

823 iso_additional_reserved_words, 

824 aglet_additional_reserved_words, 

825 ), 

826 

827 # Reserved words for GNU Modula-2 Extensions 

828 'm2pim+gm2': ( 

829 common_reserved_words, 

830 pim_additional_reserved_words, 

831 gm2_additional_reserved_words, 

832 ), 

833 

834 # Reserved words for p1 Modula-2 Extensions 

835 'm2iso+p1': ( 

836 common_reserved_words, 

837 iso_additional_reserved_words, 

838 p1_additional_reserved_words, 

839 ), 

840 

841 # Reserved words for XDS Modula-2 Extensions 

842 'm2iso+xds': ( 

843 common_reserved_words, 

844 iso_additional_reserved_words, 

845 xds_additional_reserved_words, 

846 ), 

847 } 

848 

849 # Builtins Database 

850 builtins_db = { 

851 # Builtins for unknown dialect 

852 'unknown': ( 

853 common_builtins, 

854 pim_additional_builtins, 

855 iso_additional_builtins, 

856 m2r10_additional_builtins, 

857 ), 

858 

859 # Builtins for PIM Modula-2 

860 'm2pim': ( 

861 common_builtins, 

862 pim_additional_builtins, 

863 ), 

864 

865 # Builtins for ISO Modula-2 

866 'm2iso': ( 

867 common_builtins, 

868 iso_additional_builtins, 

869 ), 

870 

871 # Builtins for ISO Modula-2 

872 'm2r10': ( 

873 common_builtins, 

874 m2r10_additional_builtins, 

875 ), 

876 

877 # Builtins for Objective Modula-2 

878 'objm2': ( 

879 common_builtins, 

880 m2r10_additional_builtins, 

881 objm2_additional_builtins, 

882 ), 

883 

884 # Builtins for Aglet Modula-2 Extensions 

885 'm2iso+aglet': ( 

886 common_builtins, 

887 iso_additional_builtins, 

888 aglet_additional_builtins, 

889 ), 

890 

891 # Builtins for GNU Modula-2 Extensions 

892 'm2pim+gm2': ( 

893 common_builtins, 

894 pim_additional_builtins, 

895 gm2_additional_builtins, 

896 ), 

897 

898 # Builtins for p1 Modula-2 Extensions 

899 'm2iso+p1': ( 

900 common_builtins, 

901 iso_additional_builtins, 

902 p1_additional_builtins, 

903 ), 

904 

905 # Builtins for XDS Modula-2 Extensions 

906 'm2iso+xds': ( 

907 common_builtins, 

908 iso_additional_builtins, 

909 xds_additional_builtins, 

910 ), 

911 } 

912 

913 # Pseudo-Module Builtins Database 

914 pseudo_builtins_db = { 

915 # Builtins for unknown dialect 

916 'unknown': ( 

917 common_pseudo_builtins, 

918 pim_additional_pseudo_builtins, 

919 iso_additional_pseudo_builtins, 

920 m2r10_additional_pseudo_builtins, 

921 ), 

922 

923 # Builtins for PIM Modula-2 

924 'm2pim': ( 

925 common_pseudo_builtins, 

926 pim_additional_pseudo_builtins, 

927 ), 

928 

929 # Builtins for ISO Modula-2 

930 'm2iso': ( 

931 common_pseudo_builtins, 

932 iso_additional_pseudo_builtins, 

933 ), 

934 

935 # Builtins for ISO Modula-2 

936 'm2r10': ( 

937 common_pseudo_builtins, 

938 m2r10_additional_pseudo_builtins, 

939 ), 

940 

941 # Builtins for Objective Modula-2 

942 'objm2': ( 

943 common_pseudo_builtins, 

944 m2r10_additional_pseudo_builtins, 

945 objm2_additional_pseudo_builtins, 

946 ), 

947 

948 # Builtins for Aglet Modula-2 Extensions 

949 'm2iso+aglet': ( 

950 common_pseudo_builtins, 

951 iso_additional_pseudo_builtins, 

952 aglet_additional_pseudo_builtins, 

953 ), 

954 

955 # Builtins for GNU Modula-2 Extensions 

956 'm2pim+gm2': ( 

957 common_pseudo_builtins, 

958 pim_additional_pseudo_builtins, 

959 gm2_additional_pseudo_builtins, 

960 ), 

961 

962 # Builtins for p1 Modula-2 Extensions 

963 'm2iso+p1': ( 

964 common_pseudo_builtins, 

965 iso_additional_pseudo_builtins, 

966 p1_additional_pseudo_builtins, 

967 ), 

968 

969 # Builtins for XDS Modula-2 Extensions 

970 'm2iso+xds': ( 

971 common_pseudo_builtins, 

972 iso_additional_pseudo_builtins, 

973 xds_additional_pseudo_builtins, 

974 ), 

975 } 

976 

977 # Standard Library ADTs Database 

978 stdlib_adts_db = { 

979 # Empty entry for unknown dialect 

980 'unknown': ( 

981 # LEAVE THIS EMPTY 

982 ), 

983 # Standard Library ADTs for PIM Modula-2 

984 'm2pim': ( 

985 # No first class library types 

986 ), 

987 

988 # Standard Library ADTs for ISO Modula-2 

989 'm2iso': ( 

990 # No first class library types 

991 ), 

992 

993 # Standard Library ADTs for Modula-2 R10 

994 'm2r10': ( 

995 m2r10_stdlib_adt_identifiers, 

996 ), 

997 

998 # Standard Library ADTs for Objective Modula-2 

999 'objm2': ( 

1000 m2r10_stdlib_adt_identifiers, 

1001 ), 

1002 

1003 # Standard Library ADTs for Aglet Modula-2 

1004 'm2iso+aglet': ( 

1005 # No first class library types 

1006 ), 

1007 

1008 # Standard Library ADTs for GNU Modula-2 

1009 'm2pim+gm2': ( 

1010 # No first class library types 

1011 ), 

1012 

1013 # Standard Library ADTs for p1 Modula-2 

1014 'm2iso+p1': ( 

1015 # No first class library types 

1016 ), 

1017 

1018 # Standard Library ADTs for XDS Modula-2 

1019 'm2iso+xds': ( 

1020 # No first class library types 

1021 ), 

1022 } 

1023 

1024 # Standard Library Modules Database 

1025 stdlib_modules_db = { 

1026 # Empty entry for unknown dialect