Intellectsoft
Software Development
SeniorDataEngineerwithPython
Neural analysis suggests this role is
optimal for Senior candidates.
“Senior Data Engineer with Python at Intellectsoft. Skills: Data Engineering, Apache Spark, SQL, Python, ETL Pipelines, Data Modeling, Apache Airflow. Design and build highly reliable and scalable data pipelines using PySpark and big data technologies. Develop new features that enhance model accuracy and performance”
What You'll Achieve.
make better decisions; work more efficiently; analyze large amounts of data; provide useful insights and predictions; optimize processes; improve customer experiences; support innovation; make quick, data-driven decisions; enhance model accuracy and performance; improve consistency across various deployments; meet requirements and deadlines
Industry & Context.
Troubleshoot and resolve issues; optimize workflows
What They're Looking For.
Must Have
6+ years of professional experience, 2+ years of data engineering with Apache Spark and SQL, Proficiency in Python for data processing and automation, Knowledge of PySpark, distributed computing, analytical databases and other big data technologies, Expertise in designing and managing ETL pipelines and distributed data processing frameworks, knowledge of database systems, data modeling, and analytical databases, Hands-on experience with workflow orchestration tools such as Apache Airflow, Solid understanding of software development lifecycles, including coding standards, version control, and testing
Nice to Have
Bachelor’s or master’s degree in Computer Science or a related field, Familiarity with the data science and machine learning development process, Understanding of Machine Learning pipelines or frameworks
What You'll Do.
Design and build highly reliable and scalable data pipelines using PySpark and big data technologies
Develop new features that enhance model accuracy and performance
Create standardized data models to improve consistency across various deployments
Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows
Conduct POCs to evaluate new technologies and integrate additional data sources
Follow and promote best practices for software development
ensuring high-quality solutions that meet requirements and deadlines
Document development updates and maintain clear technical documentation
How You'll Work.
Team & Collaboration
Collaborate with the data science team
Full Job Description
Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe. We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, and many more where our teams are making daily impactTogether, our team delivers solutions that make a difference. Learn more at [www.intellectsoft.net](http://www.intellectsoft.net/) Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions. **Requirements** * 6+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL. * Proficiency in Python for data processing and automation. * Knowledge of PySpark, distributed computing, analytical databases and other big data * technologies. * Expertise in designing and managing ETL pipelines and distributed data processing frameworks. * Strong knowledge of database systems, data modeling, and analytical databases. * Hands-on experience with workflow orchestration tools such as Apache Airflow. * Familiarity with cloud platforms like AWS, GCP, or Azure. * Solid understanding of software development lifecycles, including coding standards, version control, and testing. **Nice to have skills** * Bachelor’s or master’s degree in Computer Science or a related field. *
Applying for this Senior Data Engineer with Python role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
ANONYMOUS · UNFILTERED
What do employees actually say about Intellectsoft?
Real rants from real employees. Read before you apply.