Automating calendars for small newsrooms

The less time journalists spend on rote tasks like data entry, the better. In this project we automated collecting event information for St. Louis Magazine’s website’s event calendar.

Building simple data pipelines

It’s important to be able to deploy scrapers that will continue to scrape and store your data without you having to prompt them every time. For journalists looking to stay on top of COVID-19 trends, access to data from state and county health authorities is crucial. However, this data can often feel inaccessible, existing behind … Continued

Automating election results from local data sources

We teamed up with the Voice of OC, a non-profit, local news site in Orange County, California, to automate their live election results. We teamed up with the Voice of OC, a non-profit, local news site in Orange County, California, to automate their live election results. By integrating data from several authorities, we provided up-to-the-minute … Continued

Your first web-scraping project will be easier than you think

Last week, a colleague emailed me with a data request. She was working on a story about the shifting sands of Republican congressional rhetoric on climate change and was wondering if GOP voting records had seen any corresponding shifts in recent years. She pointed out that one good measure of environmental voting comes from the … Continued

RJI Futures Lab senior editor to teach Python data science course at CAR conference in Chicago

This week, I’ll reunite with my California Civic Data Coalition colleagues to co-teach a six-hour, hands-on session at the annual Computer-Assisted Reporting Conference in Chicago. Our class, “First Python Notebook,” is for journalists who want to learn data science. We’ll show our students how to use computer-assisted techniques to report on money in state politics, but the skills could … Continued
https://rjionline.org/tag/python/
rjionline.org
crawl=CC-MAIN-2021-39
54942
application/http; msgtype=response
sha1:RFNLJYESFT3DTJGQOUYSRNRP5DDKKHYY
<urn:uuid:fab4ca85-7486-4cf0-974e-87da67338129>
2021-09-25T21:46:07Z
34.74.8.155
text/html
sha1:EO42Q5UPFM3CLK4NUUIBU3NTL2C2JNSK
<urn:uuid:d6b25788-ecd9-4692-9468-9b7b09ef0b4e>
https://rjionline.org/tag/python/
response
<urn:uuid:d8fd51c1-fcad-41c8-abb3-d66bc945decc>
isPartOf: CC-MAIN-2021-39
publisher: Common Crawl
description: Wide crawl of the web for September 2021
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-142
software: Apache Nutch 1.18 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.2-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/