Lead Data Engineer - Remote Opportunity: Long-term Contract with Workwarp - Postgres, Kafka, Spark Streaming & High-Frequency Data Systems
Join the Future of Data Engineering with Workwarp
Workwarp is a pioneering company that's revolutionizing the way businesses interact with data. We're on a mission to create a world where data-driven insights empower organizations to make informed decisions and drive growth. As a leader in the industry, we're seeking an exceptional Lead Data Engineer to join our team on a long-term contract. If you're passionate about designing and implementing efficient data handling systems, and have a strong background in Postgres, Kafka, Spark Streaming, and high-frequency data systems, we want to hear from you!
About the Role
We're looking for a highly skilled Lead Data Engineer to lead the design, implementation, and maintenance of our data handling systems. As a Lead Data Engineer at Workwarp, you'll be responsible for ensuring the scalability, performance, and reliability of our data infrastructure. You'll work closely with our team to investigate and resolve complex data-related issues, optimize database performance, and develop data stores that support high-frequency data processing and storage.
Key Responsibilities:
- Design and Implementation: Design and implement efficient data handling systems based on Postgres or Spark tech stack, ensuring scalability, performance, and reliability.
- Database Administration: Perform database administration tasks, including PostgreSQL performance issue investigation, troubleshooting, and resolution, as well as SQL query tuning and optimization.
- Data Store Development: Implement data stores that support the scalable processing and storage of high-frequency data, ensuring data quality and integrity.
- Scripting and API Integration: Write scripts, call APIs, and write SQL queries to support data processing and analysis.
- Data Cleaning, Visualization, and Reporting: Perform data cleaning, visualization, and reporting tasks to support business insights and decision-making.
- Real-time Data Systems: Work with real-time data stream platforms such as Kafka and Spark Streaming, ensuring seamless data processing and analysis.
- Agile Environment: Work in an agile environment, collaborating with cross-functional teams to deliver high-quality data solutions.
- Hadoop Ecosystem: Work with the Hadoop ecosystem, including platforms such as MapReduce, Spark, and Hive.
- AWS: Work with AWS, ensuring seamless integration with our data infrastructure.
Requirements and Qualifications
Essential Qualifications:
- 10+ Years of Experience: 10+ years of experience in designing and implementing efficient data handling systems based on Postgres or Spark tech stack.
- PostgreSQL Expertise: Experience investigating, troubleshooting, and resolving PostgreSQL performance issues, SQL query tuning, and optimization.
- Database Administration: Experience in Database Administration, specifically in PostgreSQL.
- Real-time Data Systems: At least 4 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming.
- Agile Environment: Experience working in an agile environment.
- Hadoop Ecosystem: Familiarity with the Hadoop ecosystem, including platforms such as MapReduce, Spark, and Hive.
- AWS: Experience with AWS.
- Analytical and Problem-Solving Skills: Excellent analytical and problem-solving skills.
- Communication and Interpersonal Skills: Excellent communication and interpersonal skills.
Preferred Qualifications:
- Cloud Experience: Experience working with cloud-based data platforms.
- Data Science Background: Background in data science or related field.
- Certifications: Relevant certifications in data engineering, PostgreSQL, or related technologies.
What We Offer
Compensation and Benefits:
We offer a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.
Career Growth Opportunities:
- Professional Development: Opportunities for professional growth and development in a rapidly expanding company.
- Leadership Roles: Opportunities to take on leadership roles and shape the future of our data engineering team.
- Collaborative Environment: Collaborative and dynamic work environment with a team of experienced data engineers.
Work Environment and Culture:
We pride ourselves on a culture that values innovation, teamwork, and continuous learning. Our remote work environment allows for flexibility and work-life balance, while our regular team-building activities and virtual social events ensure that we stay connected and engaged.
How to Apply
If you're passionate about data engineering and are looking for a new challenge, we'd love to hear from you! Please submit your updated resume and a brief introduction explaining why you're the perfect fit for this role.
Conclusion
As a Lead Data Engineer at Workwarp, you'll have the opportunity to work on cutting-edge data handling systems, collaborate with a talented team, and drive business growth through data-driven insights. If you're ready to take your career to the next level and join a company that's shaping the future of data engineering, apply today!
Apply for this job