Monthly Product News - May 2024

In May 2024, Turbit has implemented several key updates to enhance efficiency and reliability of our operations. These updates focus on improving data extraction and optimizing development processes. Below is a detailed overview of the latest advancements.

Data Extraction: OPC pushes data to MQTT cluster

Our OPC data extractor now pushes raw data to our MQTT cluster. This enables us to handle real-time data streaming, providing low-latency data transfer, reduced network bandwidth usage, and reliable message delivery. Moreover, MQTT brokers can manage a large number of connections and data streams. We now have a real-time, lightweight, flexible, and scalable data extraction system, which also facilitates supplying third parties with the extracted raw data.

Datahub: first API version

Our Datahub is a centralized platform designed to streamline the collection, storage, and distribution of live and historical data across the renewable energy industry. The publication of the first version of our Datahub API now allows third parties to access raw data. This is a significant step towards data democratization, providing stakeholders with easy access to data across different organization levels.

Development Optimization: Kafka Migration

Our Kafka cluster was experiencing increased memory and storage consumption, which complicated debugging and modifications, making it difficult to maintain optimal performance and manageability. For that reason, we migrated our Kafka cluster to dedicated servers and decoupled topics by deploying them across two separate Kafka clusters: one dedicated to internal processes such as case pipelines, training, and ETL, and another for handling MQTT-related processes. This migration has provided us with better control of our Kafka cluster. The strategic separation of clusters has enhanced performance, scalability, and reliability, ensuring that our data streaming needs are met more efficiently.

Fixing Fires

We have encountered some technical difficulties in the background, which were successfully resolved. Our team is currently working to ensure that these issues do not recur, maintaining and improving the stability and safety of our platform.

By optimizing our data extraction capabilities, development infrastructure, and event detection system, we reinforce our commitment to put WTG owners in control of their wind park operations. See you next month!