Data Engineer CKAN

 The Candidate shall possess excellent knowledge of:  • Expert designing and customizing CKAN Data portals • Expert python developer  o Including experience with frameworks and libraries like Django, Flask, streamlit, pandas and numpy • Web app development experience with Python, Java and CSS • Strong knowledge and experience with PostgreSQL (OnPrem and cloud) • Strong knowledge of git and Linux OS (Ubuntu / debian / centOS) • Strong experience defining and implement CI/CD pipelines with Azure devops • Strong ing skills with PowerShell and/or Bash shell  The resource should also have:  • Good Understanding of Data engineering pipelines • knowledge of Data pipeline orchestrators and tools such as Azure Data Factory, Azure logic apps, and AWS Glue • Knowledge of python Data pipeline development with pyspark using Apache spark and Databricks 

Location: Valencia, Spain / possibility to work remotely.   

Daily activities include: • Work with the team (technical Lead/Architect/other team members) and customer focal point to understand the business need and design/implement the technical data management solution. • Design and implement CKAN Data Portals • Design and implement Data Warehouses and Data Lakes solutions, mainly Microsoft Cloud and AWS data services, based on the customers’ business requirements. • Design and implement complex ELT/ETL processes using Integration Services (SSIS), Azure Data Factory or AWS Glue or others • Design and develop Analysis Services OLAP Cubes and Tabular Views • Develop s accordingly to the data need (Stored Procedures with T-SQL, Python or R, eventually PowerShell or .NET). • Design conceptual and logical data models and data flowcharts • Design Data-as-a-Service solution, on-premises and Cloud based, based on Data API Gateway and other Cloud services. • Implement Data Catalog solutions • Migrate data from legacy systems to new data platform solutions • Improve system performance by conducting tests, troubleshooting and integrating new elements • Perform other duties as required