“Sell me this pen” – an urgent business request. Data scientists have to spend a large amount of time wrangling data from different sources and running ML algorithms. With KNIME’s Neo4j Connection node, data science teams can build an end-to-end data science orchestration pipeline. YouTube Video from Neo4j 2021 Developer Forum -> https://www.youtube.com/watch?v=NDG9lYbxP2U
If you are following today’s trend for building an efficient Modern Data Stack, all are of aware of the “parquet” format offering efficient data storage and retrieval. In addition to being an in-memory column-oriented storage format similar to ORC, it also provides features such as efficient data compression and encoding schemas, resulting in enhanced performance…
We all know about the AdventureWorks database from MS SQL Server, a replacement for Northwind and Pubs database. Just released recently, the Synapse Analytics team has introduced Templates for various subject areas around business areas. To name a few are Customer, Contract, Order, Party etc. The feature also has the flexibility of adding/removing entities and…
Supply & Demand forecasting is a hot topic in the machine learning community. The importance of operations management is widely understood for goods, commodities, and even in the service industry. Supply chain disruptions like machinery breakdown, quality concerns, inaccurate inventory records, poor forecasting, capacity, or labor shortages cause millions in losses. Machine learning algorithms are being…
A hurricane is a type of storm called a tropical cyclone, which forms over tropical or subtropical waters. Central Florida Hurricane Center ( https://flhurricane.com/ ), stores data on all Hurricanes in the US. The data contains Date & Time Latitude Longitude Wind Pressure Movement. The above data can be downloaded in a CSV format, to be…
Azure Data Factory and Azure Synapse Analytics now supports REST API data flow component for both source and sink capability for only JSON payloads currently. As part of code-free design, REST endpoints can be directly incorporated into data workflows to transform and process data in pipelines. To demonstrate the new feature, we will simply add…
Whenever we work with Azure Synapse through SSMS, we want to quickly preview the top N data. A quick way of achieving it is right-click on the table / view and select but, sometimes we don’t need the 1000’s of rows. Maybe 100 or 10 is sufficient enough. To change the default 1000 rows count,…
KNIME 4.4.0 release on June 29th 2021, gave a new approach for MongoDB Integrators. In my previous blog post, I mentioned about a error exception when writing data containing “#” to MongoDB documents. This is now fixed in KNIME 4.4.0. Also, all the MongoDB nodes are upgrade. The new MongoDB Connector nodes gives the flexibility…
Version Control for Architecture Diagrams
A Picture is Worth A Thousand Words Verison control as we traditionally know is the practice of tracking and managing source code and most importantly it is an effective collaboration means for working amongst and across teams. Most of us have used and relied on traditional software like Team Foundation Version Control, Subversion, GitHub to…
Read More