Full-time opportunity · Data Engineering
Big Data Engineer
Build dependable data pipelines that make information usable for analytics and AI. Work across ingestion, transformation, orchestration, storage and monitoring with strong attention to data quality.
Job ID:GC-FT-006
About the opportunity
What this role is about
Build dependable data pipelines that make information usable for analytics and AI. Work across ingestion, transformation, orchestration, storage and monitoring with strong attention to data quality.
GrapeCrux values practical problem-solving, clear communication and responsible engineering. The work is shaped around business needs, user outcomes and the quality of the solution delivered.
Responsibilities
- Design and maintain batch or streaming pipelines from source systems to analytical stores.
- Develop data transformations, schemas and reusable processing components.
- Improve data quality through validation, reconciliation, testing and exception handling.
- Work with distributed processing, orchestration and storage technologies where appropriate.
- Monitor pipeline health, investigate failures and improve recovery and performance.
- Clarify data definitions and delivery contracts with analytics and application teams.
Required skills and experience
- Experience building data pipelines or data-intensive software systems.
- Strong SQL and programming ability in Python, Java, Scala or another suitable language.
- Understanding of data modelling, ETL/ELT, data quality and schema management.
- Ability to investigate pipeline failures and reason about scale.
- Familiarity with Git, testing, documentation and secure data handling.
Helpful experience
- Apache Spark, Kafka, Airflow or comparable distributed data tools.
- Data lakes, warehouses, lakehouse patterns or cloud data platforms.
- Streaming systems, orchestration, lineage or data observability.
What success can look like
- Pipelines deliver trusted data with clear definitions and validation.
- Failures are observable and recoverable.
- Processing balances scale, cost, simplicity and operational ownership.
Recruitment information
Terms and working arrangements
This is an ongoing full-time opportunity with no pre-set end date stated. Compensation, work location, collaboration arrangements and other employment terms are discussed with shortlisted applicants and confirmed in writing before acceptance.
Shortlisted applicants receive the relevant role expectations and written terms to review before deciding whether to accept an offer.
Selection approach
What happens after applying?
- The team reviews your application against the role requirements and the information you provide.
- Shortlisted candidates may be invited to discuss experience, projects and approach to the work.
- A role-related technical discussion or practical exercise may be used where relevant. The format and expectations will be explained in advance.
- Any next steps and applicable conditions are shared directly with selected candidates.
Full-time role application
Apply for Big Data Engineer.
Your role and Job ID are already selected. Complete the same GrapeCrux application questions used on the Careers page.
Your browser will prepare an email to yaswanth@grapecrux.com. Attach your resume or CV, review the content and press Send in your email application. This static website does not upload or store your application.
Need an accessible application format or have a question? Contact service@grapecrux.com and include Job ID GC-FT-006.
Explore other opportunities
Explore all careers Find the role that fits your next step.
Review all full-time roles and internship tracks in the GrapeCrux Careers hub.