Neoflex Datagram is a data integration platform. Datagram@DataProc is a complex solution that includes the Neoflex Datagram visual editor integrated with the Apache Spark cluster on Yandex Data Proc services.
You can use the Neoflex Datagram visual editor to design applications for processing data from different sources, such as Oracle, Microsoft SQL Server, PostgreSQL, Hadoop, HBase, XML, Excel, and CSV, as well as upload data based on source metadata. Neoflex Datagram supports both batch and stream processing.
The application, which is developed as a collection of diagrams, is converted to Scala code, then to executable modules, and then run on Apache Oozie and Apache Livy.
Streaming mode is supported by Apache Kafka and Spark Streaming. Integration with BRMS enables you to apply business rules to event streams in real time.
Benefits
- Viewing the contents and structure of data sources and sinks.
- Loading data directly from sources without defining intermediate transformation steps.
- Tracking data stream object sources down to the individual fields (lineage).
- Partially converting and displaying intermediate results, individual transformation steps, and branches.
- Viewing generated application code.
- Automatically validating data after transformation.
- Supporting Spark Catalyst Optimizer for converting complex queries to code.
- Uploading data to analytics systems.
- Migrating databases to the cloud.
- Visually designing Data Pipelines.
- Stream data processing.
- Developing BigData stack solutions.
Neoflex
Neoflex provides technical support to Datagram users in Yandex Cloud. You can contact technical support by email at support-datagram@neoflex.ru. Support engineers are available to take your requests between 9 AM and 6 PM on business days.
Yandex Cloud
Yandex Cloud technical support is available 24/7 to respond to requests. The types of requests available and their response time depend on your pricing plan. You can enable paid support in the management console. Learn more about requesting technical support.
Yandex Cloud does not provide technical support for this product. If you have any issues, please refer to the developer’s information resources.