Data Engineer

Essential Skills:

• Design, develop, and maintain scalable data pipelines using Logstash and Elastic Agent/Beats.
• Build and optimise Elasticsearch indices, mappings, and data models to support analytics and reporting requirements.
• Ingest structured, semi-structured, and unstructured data from multiple sources.
• Develop data transformation, enrichment, and cleansing processes.
• Create and maintain Kibana dashboards, visualisations, and reporting solutions.
• Implement Real Time and batch data processing capabilities.
• Work with large datasets to improve data quality, consistency, and accessibility.
• Optimise Elasticsearch query performance and indexing strategies.
• Support data integration across cloud and on-premises platforms.
• Collaborate with business and technical teams to define data requirements and solutions.
• Monitor and troubleshoot data pipeline performance and availability.
• Automate data processing workflows and implement best practices for data governance.