iCapital
SyncWorker
Neural analysis suggests this role is
optimal for Senior candidates.
“Sync Worker at iCapital. Skills: Python, web scraping, AWS, Playwright, cloud-native deployment, automation. Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services. Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session/token-based login flows”
What You'll Achieve.
deploying scalable scraping tasks; architecting and building robust, secure, and scalable scraping solutions; systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging
Industry & Context.
ability to reverse-engineer network calls and authentication mechanisms
What They're Looking For.
Must Have
5+ years of experience in Python development, with a focus on automation and data extraction, Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests, In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session/cookie management, Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager, Experience with asynchronous programming, headless browsers, and JavaScript-rendered content, Solid understanding of web protocols (HTTP, HTTPS, cookies, headers), and ability to reverse-engineer network calls and authentication mechanisms, Comfortable working with APIs, JSON/XML, and data transformation
Nice to Have
Experience with CI/CD pipelines, Docker, and infrastructure as code (e. g. , CloudFormation, Terraform), Familiarity with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions, Prior experience scraping from secure or enterprise-level portals (e. g. , financial, healthcare, legal), Background in data engineering or ETL workflows is a plus, Exposure to Python testing frameworks and writing unit/integration tests
What You'll Do.
Assist with the design and implementation of advanced scraping solutions using Python
Automate interactions with JavaScript-heavy and authentication-secured websites
including handling MFA
and session/token-based login flows
Architect scraping pipelines using serverless AWS components such as Lambda
Build systems that scale to support high volumes of data extraction with fault tolerance
and intelligent logging
Integrate and manage complex workflows across multiple portals
Contribute to architectural decisions
Full Job Description
About the Role: We are looking for an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. You will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals. Responsibilities: Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services. Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session/token-based login flows. Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager. Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging. Integrate and manage complex workflows across multiple portals, APIs, and data sources. Contribute to architectural decisions, tooling, and best practices. Qualifications: 5+ years of experience in Python development, with a strong focus on automation and data extraction. Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests. In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session/cookie management. Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager. Experience with asynchronous programming, headless browsers, and JavaScript-rendered content. Solid understanding of web protocols (HTTP, HTTPS, cookies, headers), and ability to reverse-engineer network calls and authentication mechanisms. Comf
Applying for this Sync Worker role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about iCapital?
Real rants from real employees. Read before you apply.