o JAfQ@sdZdZddgZddlZddlZddlZddlZddlZddlm Z m Z m Z m Z m Z GdddeZd d Z  dddZddZddZddZedkrXeee dSdS)zZParser driver. This provides a high-level interface to parse a file into a syntax tree. z#Guido van Rossum Driver load_grammarN)grammarparsetokentokenizepgenc@sHeZdZdddZdddZdddZdd d Zdd d Zdd dZdS)rNcCs&||_|dur t}||_||_dS)N)rlogging getLoggerloggerconvert)selfrr r r+/usr/lib/python3.10/lib2to3/pgen2/driver.py__init__s  zDriver.__init__FcCsht|j|j}|d}d}d}}}} } d} |D]} | \}}}} } |||fkrO|\} }|| krA| d| |7} | }d}||krO| | ||7} |}|tjtjfvrk| |7} | \}}|drj|d7}d}q|t j krutj |}|r|j dt j||| |||| |fr|r|j d|jSd} | \}}|dr|d7}d}qtd||| |f) z4Parse a series of tokens and return the syntax tree.rrN z%s %r (prefix=%r)zStop.zincomplete input)rZParserrr ZsetuprCOMMENTNLendswithrOPZopmapr debugtok_nameZaddtokenZ ParseErrorrootnode)rtokensrplinenocolumntypevaluestartendZ line_textprefixZ quintupleZs_linenoZs_columnrrr parse_tokens&sX         zDriver.parse_tokenscCst|j}|||Sz*Parse a stream and return the syntax tree.)rgenerate_tokensreadliner$)rstreamrrrrrparse_stream_rawVs  zDriver.parse_stream_rawcCs |||Sr%)r))rr(rrrr parse_stream[s zDriver.parse_streamcCs@tj|d|d}|||WdS1swYdS)z(Parse a file and return the syntax tree.r)encodingN)ioopenr*)rfilenamer,rr(rrr parse_file_s $zDriver.parse_filecCstt|j}|||S)z*Parse a string and return the syntax tree.)rr&r-StringIOr'r$)rtextrrrrr parse_stringds zDriver.parse_string)NN)F)NF) __name__ __module__ __qualname__rr$r)r*r0r3rrrrrs   0  cCs:tj|\}}|dkrd}||dtttjdS)Nz.txtr.z.pickle)ospathsplitextjoinmapstrsys version_info)gtheadtailrrr_generate_pickle_namejsrC Grammar.txtTFc Cs|durt}|durt|n|}|st||sP|d|t|}|rN|d|z||W|StyM}z |d|WYd}~|Sd}~ww|St }| ||S)z'Load the grammar (maybe from a pickle).Nz!Generating grammar tables from %szWriting grammar tables to %szWriting failed: %s) r r rC_newerinfor Zgenerate_grammardumpOSErrorrGrammarload)r@Zgpsaveforcer gerrrrqs(     cCs8tj|sdStj|sdStj|tj|kS)z0Inquire whether file a was written since file b.FT)r8r9existsgetmtime)abrrrrEs  rEcCsFtj|r t|Sttj|}t||}t }| ||S)aNormally, loads a pickled grammar by doing pkgutil.get_data(package, pickled_grammar) where *pickled_grammar* is computed from *grammar_source* by adding the Python version and using a ``.pickle`` extension. However, if *grammar_source* is an extant file, load_grammar(grammar_source) is called instead. This facilitates using a packaged grammar file when needed but preserves load_grammar's automatic regeneration behavior when possible. ) r8r9isfilerrCbasenamepkgutilget_datarrIloads)packageZgrammar_sourceZ pickled_namedatarMrrrload_packaged_grammars   rZcGsB|s tjdd}tjtjtjdd|D] }t|dddqdS)zMain program, when run as a script: produce grammar pickle files. Calls load_grammar for each argument, a path to a grammar text file. rNz %(message)s)levelr(formatT)rKrL)r>argvr basicConfigINFOstdoutr)argsr@rrrmains rb__main__)rDNTFN)__doc__ __author____all__r-r8r rUr>rrrrrr objectrrCrrErZrbr4exitintrrrrs(M