loader

Effective End-To-End Data Solutions

DataStema addresses a problem with a broader impact that all companies have at some point: the solution exploration phase of data solutions, part of their buyer journey process.

Deep down, the client question in this phase can be formulated as follows: "I need a way to test various data solutions before buying them, to understand which one solves better our problems, helps us in our daily work, integrates well with the current/future environment, and comes with a reasonable price, support and maintenance costs."

From our experience working with our clients, this journey is not easy. It involves a lot of communication, alignment, mediation, and negotiation between the internal clients and the vendors. Also, we found out that this process is not transparent enough for all the parties involved, and reaching a consensus takes multiple iterations and time.

DataStema helps companies that choose Data Solutions Blueprints© to automate and deploy data solutions once they identify the organization's problems and need to take action, reducing the time, cost, and people involved in a typical Proof of Concept (POC) process.

This will also lead to a faster consensus between internal stakeholders and empower them to negotiate with the vendors. It's all about what Clients need, not about what Vendors push.

Data Solution Blueprints© represents:

Effective Data Solution

A solution that solves a specific problem, works in a productive environment, has a proven record of implementation, is documented, has at least one success story, and can be presented to a potential client.

End-To-End Data Solution

A solution that covers data architecture patterns for ingesting, storing, processing, consuming, managing, and orchestrating data and the data lifecycle management process.

Implemented By The Three Pillars

DataStema - Open Standard
Open Standard

Virtually we can create an infinite number of Data Solutions Blueprints© with the technologies from the market. But, to compare efficiently different solutions between them, we need to have common characteristics and attributes, which only a standard can provide.

We intend to use the existing standards in the industry and simplify them in a more business-terms way that not only the specialists will understand.

As deliverables part of the Open Standard, we can have: architecture diagrams and documents, functional and technical specification documents, data models, data pipelines, algorithms, scripts, and packages.

This standard will be open and transparent to all parties involved: clients, vendors, builders, and evangelists.

A governance process will be defined to maintain this standard up and running.

 

DataStema - Technical Framework
Technical Framework

To automate and deploy Data Solution Blueprints©, we develop a Technical Framework using Cloud-Native, Infrastructure as Code, DevOps, and CI/CD technologies that will follow the Open Standard rules, policies, guidelines, and best practices.

DataStema's scope is to make this Technical Framework public on our GitHub page to encourage other developers to contribute, thus creating a community.

We strongly advise using the Technical Framework for the newly built Data Solution Blueprints© taking into account the different maturity stages and limitations of these new technologies.

The Technical Framework will not be mandatory for existing Data Solution Blueprints© as most probably older technologies were used to build them, or the complexity of these solutions cannot support refactoring/rewriting to the new technologies but have to comply with the Open Standard.

DataStema - B2B Marketplace
B2B Marketplace

Our main scope is to build a B2B marketplace platform that all companies will use.

All the built Data Solution Blueprints© will be available on this marketplace as accelerators, solutions, or products cataloged by use-case on sector or industry.

We offer all developers: freelancers, small shops, or medium-large companies the possibility to make money by selling their Data Solution Blueprints© on this marketplace.

Through an online onboarding process, we will help and guide developers to submit their Data Solution Blueprints© aligned with the Open Standard and - in some cases - built with the Technical Framework on the marketplace.

Our ambition is to build a community around this platform that will create the desired network effects to go global.

 

Conceptual Architecture

Data Solution Blueprints - Conceptual Architectue
We propose a fundamental Open Standard, a conceptual architecture diagram for modern data solutions split into six zones that helps implement the most common data patterns supporting your business use-cases.
  • INGRESS/EGRESS
    • Data Source
    • Data Destination

  • FOUNDATION
    • Data Lakehouse
    • Data Extraction and Loading
    • Data Transformation
    • Headless BI

  • ANALYTICS
    • Analytics Stack
    • AI/ML Stack

  • SERVICES
    • Data as a Service
    • Reverse ETL

  • MANAGEMENT
    • Data Discovery and Catalog
    • Data Lineage
    • Data Governance
    • Data Privacy and Security
    • Data Quality and Observability

  • OPERATIONS
    • DataOps