Home › Database Architect jobs in New York, NY › EGROVE SYSTEMS CORPORATION
Data Engineer
EGROVE SYSTEMS CORPORATION · New York, NY · Posted November 19, 2026 (1 days ago)
- New York, NY
- Full time
- $30–$55 an hour
Apply on EGROVE SYSTEMS CORPORATION’s siteFill the application with AutoFillSee your fit for this role
Job description
Position: Data Engineer Location: NYC Exp: 6+ Years Employment Type: W2 & 1099 If you are interested, kindly share your updated resume at sivaraja.l@egrovesys.com
Responsibilities
- Design, build, and optimize robust, scalable pipelines in Databricks (PySpark, SQL, Delta Lake) for structured, semi-structured, and unstructured data
- Ingest and process data from diverse sources: relational databases, APIs, PDFs, Excel, flat files, and web scraping
- Implement data quality frameworks, validation checks, and automated tests to ensure reliability across the pipeline lifecycle
- Conduct UAT/UAD processes to align outputs with business
Required qualifications
- and ensure trust in data
- Own pipelines end-to-end—from development through deployment, monitoring, scaling, and continuous improvement
- Apply best practices for dataset versioning, reproducibility, and lineage (Delta Lake, MLflow, or equivalent)
- Optimize pipelines for large-scale performance and cost-efficiency in Databricks and AWS environments
- Collaborate with data science and analytics teams to deliver model-ready datasets and ensure schema stability
- Produce clear technical documentation (design docs, lineage diagrams, data dictionaries) and communicate effectively with technical and business stakeholders Required Qualifications
- 6+ years of professional experience in Data Engineering or related roles
- Hands-on expertise in Databricks (PySpark, SQL, Delta Lake)
- Proven track record of building and deploying end-to-end production pipelines at scale
- Experience working with structured and unstructured data, including extracting information from PDFs, Excel, web scraping, and APIs
- Strong foundation in data quality, testing, and observability (e.g., Great Expectations, Deequ, dbt tests, or similar)
- Ability to troubleshoot, debug, and optimize Spark/Databricks workloads for scale and performance
About us
- eGrove Systems is a highly profiled IT solution provider to a vast nation wide clientele
- Our solutions include e-commerce customization, mobile app development, digital marketing, and website optimization
- We are always looking for the right talents to join our team
- You can visit our website (https://www.egrovesys.com) for more details about our company
- An
Equal opportunity
Employer.
Posting 3701583 on careerplug. Source: the employer’s listing. Valid through January 3, 2027 unless closed earlier.