- PulseRise Technologies
- Valencian Community, VC
- 1 week ago
Job Description
<div style="text-align: justify;">We are looking for a <strong>Test Automation Engineer </strong>to join a long-term data-focused project. The role is centered on validating complex data pipelines, ensuring data quality, and automating testing for cloud-based analytics solutions built on Databricks and Azure.</div><div><br></div><div><strong>Details</strong></div><div>Start Date: ASAP</div><div>Duration: 12 months+</div><div>Location: Fully remote</div><div>Candidate Location: European Union</div><div>Language: English</div><div><br></div><div><strong>Key Responsibilities</strong></div><div>Develop and maintain automated test scripts in Databricks using Python, PySpark, and SQL</div><div>Validate JSON messages (AMQP) for structure, completeness, and accuracy</div><div>Implement data quality checks including schema validation, range checks, and anomaly detection</div><div>Validate end-to-end data flow from SCADA systems through AMQP into Databricks</div><div>Verify data transformation logic and ensure compliance with business rules</div><div>Store and document test results using Azure services (Data Lake, Blob Storage, Azure SQL)</div><div>Create dashboards and reports using Grafana or Databricks notebooks</div><div>Integrate automated tests into CI/CD pipelines using Azure DevOps</div><div>Collaborate closely with Data Engineers, SCADA specialists, and Cloud teams</div><div>Document test cases, testing procedures, and results</div><div><br></div><div><strong>Requirements (Must-Have)</strong></div><div>Strong hands-on experience with Databricks</div><div>Advanced skills in Python, PySpark</div><div>Proficiency in handling and validating JSON messages</div><div>Solid knowledge of Azure services (Data Lake, Blob Storage, Functions)</div><div>Proven experience with automated testing in cloud environments</div><div>Familiarity with CI/CD pipelines, preferably Azure DevOps</div><div><br></div><div><strong>Nice to Have</strong></div><div>Understanding of SCADA systems and renewable energy data flows</div><div>Experience working with AMQP protocols</div><div>Knowledge of telemetry / SCADA industry standards (e.g., OPC)</div><div>Experience with SQL</div>
