AvePoint - Data Architect (Managed Services)
Requirements
• Bachelor's degree or above in Computer Science, Statistics, Mathematics, Information Systems, or related technical field. • 3+ years of professional experience in data development, data engineering, or data architecture roles, with a proven track record of building production data warehouse systems. • Expert-level proficiency in SQL (complex queries, window functions, CTEs, query optimization) and Python for data processing and pipeline development. • Mastery of data warehouse modeling theories and methodologies: dimensional modeling (Kimball), normalized modeling (Inmon), and Data Vault 2.0. Demonstrated experience designing star schemas, snowflake schemas, and aggregate tables for complex business domains. • Deep domain experience in at least one complex industry: financial services (banking, securities, insurance), international trade (import/export, supply chain, logistics), or manufacturing (production planning, quality control, industrial IoT). Understanding of industry-specific data entities, business processes, and analytical requirements. • Strong hands-on experience with ETL/ELT tools and frameworks: Apache Spark (batch and streaming), Apache Flink, Hive, MapReduce, Sqoop, DataX, SeaTunnel, or commercial ETL platforms (Informatica PowerCenter, Talend, IBM DataStage). • Proficiency in workflow orchestration: Apache Airflow, DolphinScheduler, Azkaban, Oozie, or equivalent scheduling and monitoring platforms. • Production experience with at least one major data warehouse/analytics database: ClickHouse, Apache Doris, StarRocks, Hive, Greenplum, Vertica, Teradata, or Snowflake. • Strong hands-on experience with BI and visualization tools: Apache Superset, FineBI, Tableau, Power BI, Quick BI, or similar enterprise BI platforms. • Deep expertise in Data Governance with demonstrated ability to build governance systems from scratch: data catalog implementation, metadata management, automated lineage tracking (using OpenLineage, Marquez, or similar), data quality monitoring, and security audit frameworks. • Solid understanding of relational and analytical databases: PostgreSQL, MySQL, Oracle, SQL Server, Greenplum — including performance tuning, indexing strategies, and query optimization. • Experience with big data ecosystem components: HDFS, YARN, ZooKeeper, Kafka, and Hadoop distributions (CDH, HDP, Apache). • Experience with master data management (MDM) platforms and methodologies. • Familiarity with data mesh or data fabric architectural patterns for large-scale decentralized data environments. • Experience with data versioning and time-travel capabilities in modern data warehouses. • Domain knowledge on Energy Trading, Market Risk Management. • Professional certifications: CDMP (Certified Data Management Professional), DAMA-DMBOK, or vendor-specific data platform certifications. • Any personal data you share with us during the application process will be processed strictly in compliance with applicable data protection laws and our Privacy Notice.
Responsibilities
• Data Acquisition, Cleansing & Integration • Design and implement enterprise-wide data collection strategies across heterogeneous source systems (ETRM, ERP, CRM, external APIs, flat files, and databases). • Develop robust data cleansing and standardization pipelines to ensure data accuracy, consistency, and completeness across all data sources. • Build data integration frameworks to consolidate data from disparate systems into a unified enterprise data warehouse, handling schema evolution and data drift. • Implement Change Data Capture (CDC) mechanisms and incremental data loading strategies to ensure near real-time data freshness. • Data Warehouse Architecture & Modeling • Lead the design and construction of the enterprise data warehouse (EDW) using industry-proven methodologies (Inmon, Kimball, or Data Vault). • architect data marts for specific business domains (finance, sales, supply chain, operations) with clear separation of concerns. • Select and implement appropriate data warehouse technologies based on workload characteristics: batch analytics (Hive, Spark SQL), real-time analytics (ClickHouse, Apache Doris, StarRocks), or MPP databases (Greenplum, Vertica). • Design layered data architectures (ODS → DWD → DWS → ADS / Bronze → Silver → Gold) with clear data flow and transformation logic at each layer. • ETL/ELT Pipeline Development • Design, build, and maintain scalable ETL/ELT pipelines using Apache Spark, Flink, Hive, MapReduce, or proprietary ETL tools (Informatica, Talend, Kettle). • Implement workflow orchestration using Apache Airflow, DolphinScheduler, Azkaban, or Oozie to schedule, monitor, and manage data pipelines. • Establish data quality frameworks: automated validation rules, anomaly detection, data profiling, and quality scorecards to ensure pipeline reliability and data trustworthiness. • Build comprehensive monitoring and alerting systems for pipeline health, data freshness, and SLA compliance. • Optimize pipeline performance through partitioning, bucketing, indexing, and query tuning strategies. • Business Intelligence & Reporting • Develop enterprise BI reporting systems and interactive dashboards using tools such as Apache Superset, FineBI, Tableau, Power BI, or Quick BI. • Design executive dashboards, operational reports, and self-service analytics interfaces tailored to business stakeholders across finance, trading, operations, and management. • Implement metrics frameworks (KPIs, OKRs) and ensure data definitions are standardized, documented, and consistently applied across all reports. • Work directly with business units to understand analytical requirements and translate them into effective data models and visualizations. • Data Governance & Standards • Design and implement enterprise data governance frameworks from the ground up, including data ownership policies, stewardship roles, and governance workflows. • Build a centralized data catalog (using Apache Atlas, DataHub, Amundsen, or similar) documenting all data assets, business glossaries, and metadata. • Implement data lineage analysis systems to track data flow from source to consumption, enabling impact analysis and root cause diagnosis. • Establish data security and audit frameworks: access control (RBAC/ABAC), data masking, encryption policies, sensitive data discovery, and compliance audit trails. • Define and enforce data standards: naming conventions, data dictionaries, master data management (MDM) rules, and data quality SLAs. • Ensure regulatory compliance with data protection laws (GDPR, PIPL, industry-specific regulations) through governance controls and documentation.
Benefits
• We are invested in the success of our colleagues, partners, customers, and community. We do this by promoting global collaboration and taking pride in helping, sharing, mentoring, and coaching each other. • Life at AvePoint
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT