At https://remoteleaf.com, we have been doing this manually to curate remote jobs.
I spend more than 6 hours daily searching for, screening, verifying and filtering hundreds of remote jobs. So it can save you time, energy, and frustration – and hopefully, help you find a job faster
I'll check out this tool at least for the scrapping part.
Anyway I can automate applying for a job now. That would be the ultimate tool to complement this.
I was always under the impression job sites don’t like to be scraped. What are the risks in using a tool like this? I would suspect possibly getting your ip banned.
Somewhat related freecodecamp.org had a video for aggregating job results with a filter https://www.youtube.com/watch?v=lauywdXKEXI&t=196s
This is essentially what large job sites like Indeed do themselves, but they have entire teams maintaining the scraping pipeline. I've worked for one of their competitors.
Awesome to see in the screenshot that this is from somebody in Kitchener-Waterloo!
I wonder how this would be if it was backed by Elasticsearch.
Very cool OP!
Right now I use urlwatch[0] with custom python scripts that will extract data from the websites. Why should I switch to JobFunnel? What are the biggest selling points?
Unfortunately, a job search aggregator assumes that companies religiously post new jobs. The reality is when a company wants to hire it 'may' post a job to cover it butt in case of an EEO complaint. Mostly they have internal candidates, internally referred candidates, retained recruiters, applicants from career website who all rank above an external job site. My guess is a very low percentage of jobs actually get filled by job aggegator sites. imho The number of applicants from these sites is just too much, far less qualified and trusted compared to other sources.