Crawly

Crawly logo

Crawly

High-level web crawling and scraping framework for Elixir

Upvote

Crawly is an application framework for crawling websites and extracting structured data for uses such as data mining, information processing or historical archiving. It targets Elixir developers who want a spider framework in their own stack.

It requires Elixir 1.14 or later and works on GNU/Linux, Windows, macOS and BSD. The README includes a quickstart for creating a new project and adding Crawly as a dependency.

Frequently Asked Questions

Is Crawly free and open source?

Yes, Crawly is open source. It is released under the Apache-2.0 license.

What is Crawly written in?

It is built using Elixir.

Leave a Review

Share your experience with Crawly. Your review will be published after moderation.