wagey.ggwagey.ggv1.0-fcdf6c0-14-Apr
Browse Tech JobsCompaniesFeaturesPricing
Log InGet Started Free
Jobs/Senior Data Engineer Role/Black Duck Software, Inc. - Senior Data Engineer
Black Duck Software, Inc.

Black Duck Software, Inc. - Senior Data Engineer

Belfast, UK1w ago
In OfficeSeniorEMEACloud ComputingData AnalyticsSenior Data EngineerSQLPythonAWSReportingData Quality

Upload My Resume

Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT

Apply in One Click

Requirements

• Solid experience building and operating production data pipelines and datasets in a cloud environment. • Strong SQL skills and working Python experience for building data pipelines, transformations, and automation. • Handson experience with cloud platforms (AWS or Google Cloud), including core services such as compute, storage, IAM, and networking. • Experience working with both operational databases (e.g., RDSstyle systems) and analytics or columnar data stores.

Responsibilities

• Design and build data pipelines and datasets supporting one or more product areas within an established, governed data platform. • Implement ingestion patterns for batch, streaming, and event data, onboarding new data sources using existing frameworks and standards. • Build and maintain reliable data pipelines with appropriate data quality checks, basic lineage, monitoring, and alerting. • Develop curated datasets and views that are secure, discoverable, and ready for analytics, reporting, and downstream consumption. • Contribute to customerfacing data products such as datasets, metrics, exports, or feeds, ensuring accuracy and clear documentation. • Implement data models for both operational databases and analytics stores, following agreed modelling conventions and best practices. • Support ML and analytics use cases by producing trusted training datasets and featureready outputs with consistent definitions. • Optimize pipeline performance, cost, and reliability within defined architectural patterns. • Collaborate with product managers, engineers, analysts, and security partners to deliver data solutions aligned to roadmap needs. • Participate in oncall rotations and operational support for data services owned by the team. • Contribute to technical discussions, code reviews, and continuous improvement of data engineering practices.

Similar Jobs

NEORISNEORIS - Java Developer | Apache Spark & Data Processing2h ago
·Colombia
In OfficeLATAMWeb DeveloperJUnitApache SparkBaseSQLGitAirflowJava
NEORISNEORIS - Data Engineer Midel2h ago
·Global Sourcing, Colombia
In OfficeLATAMMidCloud ComputingArtificial IntelligenceData EngineerSQLPythonData QualityNeo4jAmazon NeptuneGCPAWSAzureData Governance
EucalyptusEucalyptus - MBA Intern2h ago
·UK - HQ - London
In OfficeEMEAInternInvestment BankingBankingInternMBAKPI TrackingGoogle SheetsExcelSQL
WhiteTechWhiteTech - Lead PHP Developer2h ago
·Remote - EMEA
RemoteEMEAStaffFintechPaymentsWeb3 DeveloperSymfonyDocumentationPHPPostgreSQLSQLDockerKubernetesDocker SwarmPHPUnitJenkinsReportingGRRFront-end
Altamira.aiAltamira.ai - Data&Reporting Analyst2h ago
·Europe
In OfficeEMEAData AnalystMarket Research AnalystReportingSQLMySQLPythonTableau
Get Started Free

No credit card. Takes 10 seconds.

Privacy·Terms··Contact·X
Loading...