The letter S in a light blue, stylized speech bubble followed by SpeakBits
SpeakBitsThe letter S in a light blue, stylized speech bubble followed by SpeakBits
Trending
Top
New
Controversial
Search
Groups

Enjoying SpeakBits?

Support the development of it by donating to Patreon or Ko-Fi.
About
Rules
Terms
Privacy
EULA
Cookies
Blog
Have feedback? We'd love to hear it!

Scalable Web Scraping with Serverless - Part 1

lev.engineer
submitted
a year ago
byjustadevtoprogramming

Summary

What is Serverless for Web Scraping and how to use it. How to use the Serverless Framework to build your own web scraping software. How do you use it to create your own Web scraping software? Use the following instructions to get started. Use the AWS Lambda tool to help you with the steps.
14

4 Comments

8
joseph
a year ago
The only thing I can't get behind with serverless is how attached to the AWS infrastructure it all is. The amount of boilerplate setup is heinous.
6
throwschen
a year ago
There are ways to get around the vendor lock-in but it does require some forethought.
3
joseph
a year ago
Having to plan around that just makes it not worth the effort to me. You're now wasting time fighting these environments instead of building your product.
1
justadevOP
a year ago
It's not that bad to jump ship to others, just need to pick things correctly where you sidestep the vender lock-in (picking the right DB, etc)