We are excited to announce that Dozer, a powerful platform for building low-latency data APIs (gRPC and REST) from any data source, is now open source! The Apache 2.0 license 🎉. With this move, we aim to empower the community to build and scale real-time data applications more effectively.
Dozer simplifies the process of connecting applications to various data sources, such as PostgreSQL, Kafka, or other databases & sources, enabling developers to easily create and manage real-time data APIs. By making Dozer open source, we are inviting developers to contribute to its growth and help shape the future of real-time data applications.
In today's data-driven world, having access to real-time data is crucial and gaining a value from the data is more cumbersome. Another challenge developers face when working with real-time data is efficiently and quickly fetching, processing, and displaying the insights from the data.
Enter Dozer, it simplifies the process of creating low-latency data APIs (gRPC and REST) from any data source easily with OpenAPI specification. Dozer is a real-time data engineering tool built with Rust, which enables seamless integration of data streams(sources), efficient data processing, and lightning-fast response times. This allows developers to focus on building applications without worrying about the complexity of managing real-time data.
To know more about it's capabilities and features you can checkout Dozer repository.
In this blog, we'll walk you through the process of creating a real-time flight data application using Dozer, React.
For this particular blog, we are using PostgreSQL as our data source, but it's important to note that there can be multiple data sources that can be connected to Dozer and subsequently used by your React application. By using Dozer, you can quickly create efficient data APIs that enable seamless integration with your frontend applications.
PostgreSQL is connected to Dozer via PostgreSQL connector and fetches data from multiple Postgres tables that has a flight data and combines them in real time based on the queries and produces fast low latency APIs.
🌟 Welcome to this week's update on dozer! Dozer is excited to announce the release of version v0.1.17, which brings a host of new features and improvements. Our team has been working tirelessly to enhance the overall functionality, and we can't wait for you to experience all the new features. Here are the updates for this week.
Dozer is a powerful, plug-and-play data infrastructure back end designed to help developers build real-time,low-latency data APIs (gRPC and REST) from any data source data apps quickly and efficiently. Dozer streamlines the process of accessing and managing real-time data updates. Key features include support for various data types, optimized join indexes structure, high-performance cache and seamless authorization implementation for gRPC/REST methods.
AirByte and ElasticSearch are often used together to extract and serve data more efficiently. However, this might not be the best solution.
TL;DR:
| Ingestion | Lookup | Complex Query* |
|---|
| AirByte+ElasticSearch | ~480s | ~24ms | ~250ms** |
| Dozer | ~30s | ~1.3ms | ~1.3ms** |
Welcome to this week's update on dozer! We are excited to share with you the latest developments and progress that we have made. Here are the updates for this week.
Release v.0.1.13
Dozer v.0.1.13 is avaiable. Checkout the release notes here.
Welcome to this week's update on dozer! We are excited to share with you the latest developments and progress that we have made. We have plently of updates for this week.
As promised, we are creating samples to demonstrate Dozer's end to end capability. Here is our first walkthrough from one of our engineers Chloe.
Every company I meet today has a data platform. And if they don’t have one, they want one. Problem is that building and maintaining a data platform is not trivial. First, multiple tools need to be integrated together: Airflow, Spark, Presto, Kafka, Flink, Snowflake, and potentially many more, but, more importantly, a dedicated engineering team must be setup to maintain and make sure everything runs smoothly. And, what usually happens is that, after data has been accumulated for months and months, the cost of running such infrastructure is higher than the benefit.
So the question is: do you really need a data platform ?
Starting this week, we want to communicate our progress through a weekly blog series. Please reach out to us with any feedback or if you like to see anything in particular. This is a mega update where we released several features that were in development.
Dozer is now available on homebrew and deb install.
# Mac
brew tap getdozer/dozer
brew install dozer
# Ubuntu
curl -sLO https://github.com/getdozer/dozer/releases/latest/download/dozer-linux-x86_64.deb \
&& sudo dpkg -i dozer-linux-x86_64.deb
As a developer, you're no stranger to the challenges of creating a cohesive API from multiple microservices. But with Dozer, you can say goodbye to the complexity and hello to lightning-fast results. Dozer automates every step of the process, from building data pipelines to real-time data aggregation, indexing, and lightning-quick queries. With just a simple configuration, you can generate gRPC and REST APIs and integrate with your customer-facing products. Let's walk through the experience of the speed and ease of real-time API creation with Dozer.
