The Website That Looked Like It Needed Selenium (But Didn’t)

For my thesis I needed a large corpus of Hindi poetry. Hindwi is one of the better maintained Hindi literature archives on the internet. Thousands of poems, hundreds of poets, content spanning from the 8th century to contemporary writers. It had everything I needed. I didn’t plan to spend much time on the scraper. Collect the data, move on. That didn’t happen. The Obvious Problem Visit hindwi.org/poets and you’ll see a listing of poets. Scroll down and more appear. Visit an individual poet’s pag