Job Description
Position: Python Developer
Location: Jersey City, NJ
Contract
MUST HAVE:
- Python/Pyspark scripting
- Glue / lambda
- Snowflake (sql, stored procs)
- Airflow or equivalent orchestration
- AWS Cloud fomation
- Informatica
Job Description
- Design and implement data pipelines to extract, transform, and load data from various sources into a data warehouse
- Develop and maintain data models and schemas to support business intelligence and analytics applications
- Optimize data storage and retrieval systems for performance and scalability
- Collaborate with data scientists and analysts to develop and deploy machine learning models and algorithms
- Implement data governance policies and procedures to ensure data quality, security, and compliance
- Manage and monitor data processing and storage infrastructure, including cloud-based platforms such as AWS
- Develop and maintain ETL workflows using tools
- Design and implement data integration solutions for thirdparty applications and services
- Conduct performance tuning and optimization of database systems and queries
- Mentor and train junior data engineers and other team members on best practices and emerging technologies in data engineering.
- Building and managing DevOps & DataOps CI/CD pipelines and automated deployments
- Debugging and resolving issues with cloud service configuration, integration, performance, security standards, scalability.
- Prepare technical design documents and SLA agreements
- Ensure the delivery of thorough project documentation.
- Introduce best practices and provide necessary support from the Center of Excellence as needed.
- Manage the identification, evaluation, mitigation, and reporting of project risks.
- Set quality standards and perform regular quality reviews.
- Ensure that project issues and challenges are resolved promptly in collaboration with the client.
Job Tags
Contract work,