+
CiyL X R t ^ RIHt RtR.t^ RIHt ^ RIt^ RIH t H
t
H t H t H
t
HtHtHtHtHtHt ^ RIHtHtHtHtHtHt ^ RIH t H t ^ R I H t H t H!t!H"t" ^ R
I#H$t$ ]' d ^ R I%H&t& ^ R IH't' ^ R
I(H)t)H*t*H+t+ Rt,]
] ]-]-3, ]-]-.R3, t. ! R R]] 4 t/ ! R R]!4 t0R# )zCUse the HTMLParser library to parse HTML files that aren't too bad.) annotationsMITHTMLParserTreeBuilder)
HTMLParserN) AnyCallablecastDictIterableListOptional
TYPE_CHECKINGTupleTypeUnion)
AttributeDictCDataComment DeclarationDoctypeProcessingInstruction)EntitySubstitution
UnicodeDammit)DetectsXMLParsedAsHTMLHTMLHTMLTreeBuilderSTRICTParserRejectedMarkup)
BeautifulSoup)NavigableString) _Encoding
_Encodings
_RawMarkupz html.parserc R ] tR t^>t$ RtR]R& RtR]R& R]/R R lltR ]R& R
]R & R ]R
& R R ltR R lt R*R R llt
R*R R llt R R lt ]
P ! R4 t]
P ! R4 t]R R l4 tR R ltR R ltR R! ltR" R# ltR$ R% ltR& R' ltR(tR)# )+BeautifulSoupHTMLParserreplacestrREPLACEignoreIGNOREon_duplicate_attributec ( V ^8 d QhRRRRRRRR/# ) soupr argsr r+ &Union[str, _DuplicateAttributeHandler]kwargs )formats "9/usr/lib/python3/dist-packages/bs4/builder/_htmlparser.py __annotate__$BeautifulSoupHTMLParser.__annotate__U s3 ( (( ( !G (
( c Wn W n VP P V n \ P
! V .VO5/ VB . V n V P 4 R # N)r. r+ builderattribute_dict_classr __init__ already_closed_empty_element_initialize_xml_detector)selfr. r+ r/ r1 s &&$*,r4 r< BeautifulSoupHTMLParser.__init__U sO &<#$(LL$E$E!D24262 -/) %%'r7 r0 z List[str]r= r r. c V ^8 d QhRRRR/# )r- messager' returnNoner2 )r3 s "r4 r5 r6 p s , ,S ,T ,r7 c \ V4 hr9 r )r? rB s &&r4 error BeautifulSoupHTMLParser.errorp s #7++r7 c $ V ^8 d QhRRRRRR/# )r- tagr' attrs List[Tuple[str, Optional[str]]]rC rD r2 )r3 s "r4 r5 r6 s$
>
r7 c
N V P WRR7 V P V4 R# )zmHandle an incoming empty-element tag.
html.parser only calls this method when the markup looks like
.
F)handle_empty_elementN)handle_starttag
handle_endtag)r? rI rJ s &&&r4 handle_startendtag*BeautifulSoupHTMLParser.handle_startendtag s%
Se D 3 r7 c ( V ^8 d QhRRRRRRRR/# ) r- rI r' rJ rK rM boolrC rD r2 )r3 s "r4 r5 r6 s2 <, <,
<, /<, # <,
<,r7 c
V P 4 pV Fg w rVVf RpWT9 dS V P pWpP 8X d K/ VRV P 39 d WdV& KH \ \
V4 pV! WEV4 Kc WdV& Ki V P P P ' d V P 4 w rMR;rV P P VRRWHV R7 p
V
eI V
P ' d7 V' d/ V P VRR7 V P P V4 V P f V P! V4 R# R# )zHandle an opening tag, e.g. ''
:param handle_empty_element: True if this tag is known to be
an empty-element tag (i.e. there is not expected to be any
closing tag).
N )
sourceline sourceposF)check_already_closed)r; r+ r* r( r _DuplicateAttributeHandlerr. r: store_line_numbersgetposrN is_empty_elementrO r= append_root_tag_name_root_tag_encountered) r? rI rJ rM attr_dictkeyvalueon_duperV rW tagObjs &&&& r4 rN 'BeautifulSoupHTMLParser.handle_starttag s4 $(#<#<#> JC } 55kk) t|| 44%*cN "#=w GGIE2!&#% , 99 / / /$(KKM !J %) )J** tY +
&"9"9"9>R
s ?
- - 4 4S 9 & & &s + 'r7 c $ V ^8 d QhRRRRRR/# )r- rI r' rX rS rC rD r2 )r3 s "r4 r5 r6 s! ) ) )D )D )r7 c
V' d. WP 9 d V P P V4 R# V P P V4 R# )zHandle a closing tag, e.g. ''
:param tag: A tag name.
:param check_already_closed: True if this tag is expected to
be the closing portion of an empty-element tag,
e.g. ''.
N)r= remover. rO )r? rI rX s &&&r4 rO %BeautifulSoupHTMLParser.handle_endtag s: C+L+L$L
- - 4 4S 9 II # #C (r7 c V ^8 d QhRRRR/# r- datar' rC rD r2 )r3 s "r4 r5 r6 s $ $ $ $r7 c
< V P P V4 R# )z4Handle some textual data that shows up between tags.N)r. handle_datar? rl s &&r4 rn #BeautifulSoupHTMLParser.handle_data s d#r7 z
^([0-9]+)(.*)z^([0-9a-f]+)(.*)c V ^8 d QhRRRR/# )r- namer' rC zTuple[str, bool, str]r2 )r3 s "r4 r5 r6 s 4; 4;3 4;CX 4;r7 c
RpRpRp^
pV P pVP R4 ' g VP R4 ' d VR, p^pV P pRp \ W4 pVf RpTpM\ P ! V4 w r#W#V3# \ dQ TP T4 pTe9 \ TP
4 ^ , T4 pTP
4 ^, p Li ; i)aX Convert a numeric character reference into an actual character.
:param name: The number of the character reference, as
obtained by html.parser
:return: A 3-tuple (dereferenced, replacement_added,
extra_data). `dereferenced` is the dereferenced character
reference, or the empty string if there was no
reference. `replacement_added` is True if the reference
could only be dereferenced by replacing content with U+FFFD
REPLACEMENT CHARACTER. `extra_data` is a portion of data
following the character reference, which was deemed to be
normal data and not part of the reference at all.
rU FxX: NNN) &_DECIMAL_REFERENCE_WITH_FOLLOWING_DATA
startswith"_HEX_REFERENCE_WITH_FOLLOWING_DATAint
ValueErrorsearchgroupsr numeric_character_reference) clsrr dereferencedreplacement_added
extra_databasereg real_namematchs && r4 (_dereference_numeric_character_reference@BeautifulSoupHTMLParser._dereference_numeric_character_reference s !&
88 ??3 4??3#7#78DD88C"& /DI$ L J.;.W.WXa.b +L
::- / JJt$E q 14 8 "\\^A .
/s B
AC('C(c V ^8 d QhRRRR/# r- rr r' rC rD r2 )r3 s "r4 r5 r6 s
)
)3
)4
)r7 c
V P V4 w r#pV' d RV P n Ve V P V4 Ve V P V4 R# R# )zHandle a numeric character reference by converting it to the
corresponding Unicode character and treating it as textual
data.
:param name: Character number, possibly in hexadecimal.
TN)r r. contains_replacement_charactersrn )r? rr r r r s && r4 handle_charref&BeautifulSoupHTMLParser.handle_charref sV 7;6c6cdh6i3 8 '??CCDI D 4 s GS FC ( JQ (. CB"++
,
<,|)$$ .0ZZ-H*)+4F)G&4; 4;l
) &##
1 1r7 r% c a ] tR tRt$ RtRtR]R& RtR]R& ]t R]R & ] ]
] .t R
]R & R ]R
& Rt
R]R& RR V 3R llltRR R llt]3R R lltRtV ;t# )r il zA Beautiful soup `bs4.builder.TreeBuilder` that uses the
:py:class:`html.parser.HTMLParser` parser, found in the Python
standard library.
FrS is_xmlT picklabler' NAMEz
Iterable[str]featuresz$Tuple[Iterable[Any], Dict[str, Any]] parser_argsTRACKS_LINE_NUMBERSc $ V ^8 d QhRRRRRR/# )r- r zOptional[Iterable[Any]]
parser_kwargszOptional[Dict[str, Any]]r1 r r2 )r3 s "r4 r5 "HTMLParserTreeBuilder.__annotate__} s( 8 8, 8 0 8 8r7 c
< \ 4 pR F pWS9 g K VP V4 pWdV& K" \ \ V ` ! R/ VB T;' g . pT;' g / pVP V4 RVR& W3V n R# )aB Constructor.
:param parser_args: Positional arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param parser_kwargs: Keyword arguments to pass into
the BeautifulSoupHTMLParser constructor, once it's
invoked.
:param kwargs: Keyword arguments for the superclass constructor.
Fconvert_charrefsN)r+ r2 )dictpopsuperr r< updater )r? r r r1 extra_parser_kwargsargrb __class__s &&&, r4 r< HTMLParserTreeBuilder.__init__} s $ #f.C}
3+0C( / #T3=f=!''R %++
01,1
() '7r7 c
, V ^8 d QhRRRRRRRRRR /# )
r- markupr# user_specified_encodingzOptional[_Encoding]document_declared_encodingexclude_encodingszOptional[_Encodings]rC zDIterable[Tuple[str, Optional[_Encoding], Optional[_Encoding], bool]]r2 )r3 s "r4 r5 r sD F FF "5F %8 F
0 F
N
Fr7 c #
l " \ V\ 4 ' d VRRR3x R# . pV' d VP V4 . pV' d VP V4 \ VVVRVR7 pVP f \ R4 hVP VP VP VP 3x R# 5i)a Run any preliminary steps necessary to make incoming markup
acceptable to the parser.
:param markup: Some markup -- probably a bytestring.
:param user_specified_encoding: The user asked to try this encoding.
:param document_declared_encoding: The markup itself claims to be
in this encoding.
:param exclude_encodings: The user asked _not_ to try any of
these encodings.
:yield: A series of 4-tuples: (markup, encoding, declared encoding,
has undergone character replacement)
Each 4-tuple represents a strategy for parsing the document.
This TreeBuilder uses Unicode, Dammit to convert the markup
into Unicode, so the ``markup`` element of the tuple will
always be a string.
NFT)known_definite_encodingsuser_encodingsis_htmlr zPCould not convert input to Unicode, and html.parser will not accept bytestrings.)
isinstancer' r] r unicode_markupr original_encodingdeclared_html_encodingr )r? r r r r r r dammits &&&&& r4 prepare_markup$HTMLParserTreeBuilder.prepare_markup s 2 fc " "4u- - 57 "
% + +,C D*, %
! !"< = %=) /
( 'b
%%((--66
s *B4B4A,B4c $ V ^8 d QhRRRRRR/# )r- r r#
_parser_classz type[BeautifulSoupHTMLParser]rC rD r2 )r3 s "r4 r5 r s# 1 1: 15R 1pt 1r7 c
, V P w r4\ V\ 4 ' g Q hV P f Q hV! V P .VO5/ VB p VP V4 VP 4 . Tn R# \ d p\ T4 hRp?ii ; i)z
:param markup: The markup to feed into the parser.
:param _parser_class: An HTMLParser subclass to use. This is only intended for use in unit tests.
N) r r r' r. feedcloseAssertionErrorr r= )r? r r r/ r1 parseres &&& r4 r HTMLParserTreeBuilder.feed s
'' &#&&&&
yy$$$ tyy:4:6: * KK LLN /1+ * 'q) ) *s !A8 8 B BB)r )NN)NNN)r r r r __doc__r r r
HTMLPARSERr r r r r r< r r% r r
__classcell__)r s @r4 r r l sn FDItD# #T6 2Hm255 !%$ 8 8r s I " # 9 0!+
%tCH~sC&@$&F G k1j*@ k1\ T1O T1r7