Job Board Scraping: API Endpoints & Cheat Sheet
Source: Dev.to
LinkedIn Guest Endpoint
URL: https://www.linkedin.com/jobs-guest/jobs/api/seeMoreJobPostings/search
Method: GET
Critical Headers
User-Agent: Mozilla/5.0 ... Chrome/120.0... # Use a real browser string
Upgrade-Insecure-Requests: 1
Parameters
| Parameter | Example / Description |
|---|---|
keywords | "software engineer" |
location | "Remote" |
start | Pagination offset (0, 25, 50, …) |
f_TP | 1 – filters for “Last 24 hours” to avoid dead links |
The endpoint returns clean JSON; no HTML scraping is required.
Remotive API
URL: https://remotive.com/api/remote-jobs
Parameters
category=software-devlimit=10
The response is a JSON payload containing remote job listings.
Arbeitnow API
URL: https://www.arbeitnow.com/api/job-board-api
The endpoint returns a massive JSON list; you can filter the results client‑side.
Rate Limiter (Python Snippet)
Always pause between requests to avoid IP bans.
import time
import requests
# Be polite
time.sleep(2)
response = requests.get(url, headers=headers)
If you find this useful, you can check out the original repository:
Zayan-Mohamed/til (Give it a star if it helps!)