Data Engineer

Location: 100% remote

Salary: 900 PLN net + VAT/day/B2B

Currently, we are looking for a Data Engineer skilled in shell and bash!
Location: 100% remotely/Warsaw
$: up to 1120 zł net/day/B2B

• You would join a newly formed team responsible for maintaining Data Referential applications ingestion component around third party API/Files upload, an MDM and business workflow tool ingesting, controlling, enhancing data and finally data distribution via databases, APIs and ETLs.
• Responsibilities:
• Integration of third party provider data (via Files, APIs, Events)
• Upgrading vendor components through their major and minor patches
• Maintenance of connectivity with internal customer applications sourcing their data referential information via WebServices, APIs, ETLs
• Reducing platform complexity by reducing point to point connections and favoring API connectivity
• Building Data quality controls to monitor all our third-party data and data sent to our customers
• Integration and maintenance of data referentials in a Dataplatform
• Building and maintaining CI/CD Pipelines, shared libraries (data pipeline development, data quality, data lineage)
• Designing and maintaining APIs

• Scripting: Shell/bash, Powershell
• Scheduling management Control M API (ideally)
• Experience working with data of various formats (np. Avro, Parquet, JSON, CSV)
• SQL expertise, knowledge of Microsoft SQL
• ETL management
• API building/maintenance
• Git CD/CI