Data Pipeline Engineer

Vintti is a cutting-edge staffing agency revolutionizing the way US companies build their teams. Leveraging advanced technology and embracing the power of remote work, we connect SMBs, startups, and firms across the United States with top-tier talent from Latin America. Our platform seamlessly integrates professionals into US business ecosystems, regardless of physical borders. Vintti operates on the principle of a borderless future of work, where skills and expertise trump geographical constraints.

A Data Pipeline Engineer plays a crucial role in managing and optimizing the flow of data within an organization. They design, develop, and maintain scalable data pipelines that ensure seamless data movement from various sources to the desired destinations. By leveraging technologies like ETL (Extract, Transform, Load) processes, they work to ensure data integrity, availability, and security. Their efforts enable data scientists and analysts to access clean, reliable data efficiently, driving business insights and decision-making processes. Constantly monitoring performance and troubleshooting issues, Data Pipeline Engineers contribute to the overall data strategy and infrastructure of the company.

- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
- 3+ years of experience in data engineering or a similar role.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL and writing complex queries.
- Hands-on experience with ETL/ELT tools and processes.
- Familiarity with data warehousing concepts and technologies.
- Experience with cloud platforms such as AWS, Google Cloud, or Azure.
- Knowledge of big data technologies such as Hadoop, Spark, or Kafka.
- Strong understanding of data modeling and data architecture principles.
- Experience with data pipeline orchestration tools like Apache Airflow or Luigi.
- Familiarity with containerization technologies like Docker and Kubernetes.
- Knowledge of CI/CD practices and tools for automated deployment.
- Experience with monitoring and logging tools to track data pipeline performance.
- Excellent problem-solving and troubleshooting skills.
- Strong verbal and written communication skills.
- Ability to work collaboratively in a team environment.
- Knowledge of data governance and compliance standards.
- Experience in implementing data security measures and practices.
- Ability to handle multiple tasks and prioritize in a dynamic environment.
- High attention to detail and commitment to data accuracy.

- Design and develop scalable data pipelines to support data analytics and business intelligence.
- Integrate and manage new data sources for timely and accurate data ingestion.
- Monitor, troubleshoot, and optimize data pipeline performance.
- Collaborate with stakeholders to understand and meet data requirements.
- Develop, optimize, and maintain SQL queries and ETL scripts.
- Implement data validation and testing procedures for data accuracy.
- Conduct data profiling and propose solutions for data anomalies.
- Maintain comprehensive documentation for data pipelines and processes.
- Implement and manage data security and compliance controls.
- Utilize cloud platforms like AWS, Google Cloud, or Azure for data pipelines.
- Automate routine data processing tasks for efficiency.
- Stay informed on industry best practices and emerging technologies.
- Support and guide team members on complex data pipeline issues.
- Work with DevOps teams on deployment and monitoring of infrastructure.
- Conduct code reviews and performance optimization of existing pipelines.
- Participate in team meetings for project updates and task coordination.

The ideal candidate for the Data Pipeline Engineer role will possess a Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field, with over three years of hands-on experience in data engineering. This individual has strong proficiency in programming languages such as Python, Java, or Scala, and adeptly writes and optimizes complex SQL queries. Hands-on experience with ETL/ELT tools, cloud platforms like AWS, Google Cloud, or Azure, and big data technologies such as Hadoop, Spark, or Kafka are essential. The candidate is well-versed in data modeling, data architecture principles, and utilizes orchestration tools like Apache Airflow or Luigi proficiently. Embracing containerization technologies like Docker and Kubernetes, and familiar with CI/CD practices, they adeptly monitor and log data pipeline performance for continuous improvements. Possessing excellent analytical, problem-solving, and troubleshooting skills, the person is detail-oriented, highly organized, and capable of managing multiple priorities in a fast-paced environment. The perfect fit for this role values collaboration, exhibits strong communication skills, and demonstrates a proactive and independent work ethic. They hold a deep understanding of data governance, security measures, and compliance standards, maintaining a high commitment to data accuracy and integrity. Enthusiastic about the potential of data to drive business insights, they bring a patient, persistent, and innovative mindset, are adept at mentoring and supporting team members, and take ownership of projects with a strong sense of responsibility. This candidate remains calm under pressure, is solutions-oriented, and excels in conveying technical concepts to non-technical stakeholders, consistently striving for excellence and continuous improvement.

- Design, implement, and maintain scalable data pipelines to support data analytics and business intelligence.
- Integrate new data sources and manage data ingestion processes to ensure timely and accurate data availability.
- Monitor and troubleshoot data pipeline performance, addressing issues related to data quality, latency, and reliability.
- Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and ensure data solutions meet business needs.
- Write, optimize, and maintain SQL queries and scripts for data extraction, transformation, and loading (ETL) processes.
- Implement data validation and testing procedures to ensure data accuracy and consistency throughout the pipeline.
- Perform data profiling and analysis to identify data anomalies and propose solutions for data cleansing.
- Maintain and update documentation for data pipelines, processes, and infrastructure.
- Implement and manage data security and compliance controls to protect sensitive information.
- Utilize cloud-based platforms such as AWS, Google Cloud, or Azure to build and scale data pipelines.
- Automate routine data processing tasks to improve efficiency and reduce manual intervention.
- Stay updated with industry best practices, new technologies, and tools to continuously improve data engineering processes.
- Provide support and guidance to other team members in resolving complex data pipeline issues.
- Collaborate with DevOps teams to deploy, monitor, and maintain pipeline infrastructure and applications.
- Conduct code reviews and optimize existing pipelines for performance improvements.
- Participate in team meetings to discuss project progress, challenges, and upcoming tasks.

- Strong analytical and problem-solving skills
- Detail-oriented with a commitment to data accuracy and integrity
- Highly organized and able to manage multiple tasks and priorities efficiently
- Proactive and able to work independently with minimal supervision
- Strong collaboration and teamwork skills
- Excellent verbal and written communication skills
- Adaptable and open to learning new technologies and industry best practices
- Innovative mindset with a focus on continuous improvement
- Ability to troubleshoot and resolve complex technical issues
- Strong coding and scripting skills
- Ability to work in a fast-paced and dynamic environment
- Strong understanding of data security and compliance
- Enthusiastic about data and its potential to drive business insights
- Patient and persistent when dealing with challenging data issues
- Strong sense of responsibility and ownership of projects
- Ability to effectively communicate technical concepts to non-technical stakeholders
- Passionate about mentoring and supporting team members
- Self-motivated with a strong desire to achieve excellence
- Ability to remain calm and focused under pressure
- Creative and solutions-oriented mindset

- Competitive salary range
- Comprehensive health benefits (medical, dental, vision)
- Flexible work hours
- Remote work options
- Generous paid time off and holidays
- Retirement savings plan with employer match
- Professional development and training opportunities
- Tuition reimbursement programs
- Access to latest tools and technologies
- Collaborative and inclusive work environment
- Employee wellness programs
- On-site fitness center or gym membership discounts
- Company-sponsored social and networking events
- Employee resource groups and mentorship programs
- Performance-based bonuses and incentives
- Opportunities for career advancement and growth
- Travel allowance or flexible schedule for conferences and industry events
- Support for continuing education and certifications
- Regular team-building activities and outings
- Childcare support or family care benefits
- Life and disability insurance
- Commuter benefits or transportation stipends
- Ergonomic workplace setups and equipment
- Employee recognition and awards programs
- Volunteering and community service opportunities