Current Slide

Small screen detected. You are viewing the mobile version of SlideWiki. If you wish to edit slides you will need to use a larger device.

Dictionary storage - first cut

  • Array of fixed-width entries
    • ~400,000 terms; 28 bytes/term = 11.2 MB.

                     ↓                        20 bytes                4 bytes each

                   

Dictionary search structure


Speaker notes:

Content Tools

Sources

There are currently no sources for this slide.
https://slidewiki.org/deck/220-2/information-retrieval-(lecture-series)/slide/1590-3/128-2:5;318-2:4;317-2:10;313-2:2;1590-3:3/view
slidewiki.org
crawl=CC-MAIN-2021-39
886477
application/http; msgtype=response
sha1:32VMSQUI4IUVE6MWPH5IHFXA4RPF34CU
<urn:uuid:221195e8-f096-4261-a882-aa31d2b5d7f6>
2021-09-18T01:50:12Z
194.95.115.98
text/html
sha1:UZH2IPWVEWWJFBDO6IZBUDIRI57NL3UY
<urn:uuid:689047ca-440c-44df-9c86-df677c81e514>
https://slidewiki.org/deck/220-2/information-retrieval-(lecture-series)/slide/1590-3/128-2:5;318-2:4;317-2:10;313-2:2;1590-3:3/view
response
<urn:uuid:95698f3d-0968-422a-bc6b-78d81f07e599>
isPartOf: CC-MAIN-2021-39
publisher: Common Crawl
description: Wide crawl of the web for September 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-143
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/