Manage spreadsheet import, mapping, and validation for web applications

Work meeting
Work meeting
Photo by Scott Graham on Unsplash.

When it comes to data, spreadsheets are incredibly useful and versatile. If your web app deals with any type of data — from sales pipelines to profit and loss statements — you’ve likely dealt with importing CSV files.

One of the first issues you run into with CSV uploads is the formatting of the data. For example:

  • What if the data is formatted differently (i.e. a date formatted MM-DD-YYYY instead of YYYY-DD-MM)?
  • What if some of the data is invalid (i.e…


How I built a QBO integration to monitor department revenues and costs with Python

Recently I was tasked with building a Quickbooks Online (QBO) integration to process the Profit and Loss (P&L) report and determine the revenues, cost of goods sold (COGS), and expenses of departments — here’s how I did it.

Source: unDraw

This article is not about building an OAuth flow or pulling data from the Quickbooks API using a cron job. That process is relatively boilerplate and has been solved by tools such as the one I’ll be using. If building that yourself interests you, check out my article on using Singer to do just that.

Instead, this article will walk you through…


Using Python to import Journal Entry spreadsheets to Quickbooks Online, for free

If you’ve dealt with importing data into Quickbooks Online, you know it’s a tedious process. In fact, it’s such a hassle that companies like SaasAnt have built products dedicated solely to automating this process.

In this article, I’ll show you how to leverage hotglue’s target-quickbooks to import CSV data into Quickbooks.

Source: unDraw

Step 1: Format your Spreadsheet

First, we have to put our Journal Entries spreadsheet in a format that the target-quickbooks package can understand. Name the file JournalEntries.csv the columns should be:

Transaction Date - The day the transaction occurredJournal Entry Id - The ID of the Journal Entry (becomes the DocNumber in QBO)


Combining Cumul.io’s embedded analytics platform with a hotglue Quickbooks data integration pipeline

Demo of the combined functionality of Cumul.io and hotglue

Often, companies want to use data they have to analyze trends. For example, if you want to look at accounting trends, common questions are:

  • what does the churn look like this month? what about last month?
The final Cumul.io dashboard

Whether you are building a SaaS platform that analyzes customer data, or you are analyzing internal company data, Cumul.io and hotglue can help.

In this article, we will use hotglue to pull Invoice data from Quickbooks, process that data using a Python script, and push it to…


How cloud computing, the Python stack, data warehouses, and the growth of SaaS platforms are poised to change the face of data integration.

Cloud computing, big data, machine learning, data lakes, data warehouses — no doubt, if you’ve been following the tech world you’ve heard these buzz words. These trends and the resulting technologies have changed the world and are continuing to unearth new opportunities for innovation.

If you looked at the face of data integration 15 years ago when Talend, now a behemoth in the space, launched Talend Open Studio the words that came to mind were “drag and drop” interface, SQL-based, on premise, and Windows native. Since then, things have changed dramatically.

“We have observed an industry transition to cloud-based technologies…


The tools that make creating data integration pipelines easier than ever for B2B developers

If you’re a B2B developer building a new product one of the earliest and most fundamental decisions in the product development phase is

How the heck will I get customer data into the product?

Source: unDraw

Whether you’re building:

  • sales software that needs to pull CRM data from Salesforce and HubSpot and billing data from Stripe or Chargebee
  • marketing software that needs to pull analytics data from Google Analytics or file uploads
  • or any other type of SaaS software

The trend is the same: data is only getting…


Building a lightweight Quickbooks data integration pipeline using Python

If you’re a B2B developer building a product, one of the earliest product development phases is creating a data integration pipeline to import customer data.

In this article, I’ll show you how to leverage Singer’s tap-quickbooks to extract data from Quickbooks. From there I’ll walk you through how to parse the JSON output data from Singer using target-csv and standardize it using a simple Python script.

Source: unDraw

Notes

The code for these examples is available publicly on GitHub here, along with descriptions that mirror the information I’ll walk you through.

These samples rely on a few open source Python packages:


Building a lightweight Salesforce data integration pipeline using Python

If you’re a B2B developer building a product, one of the earliest product development phases is creating a data integration pipeline to import customer data.

In this article, I’ll show you how to leverage Singer’s tap-salesforce to extract data from Salesforce. From there I’ll walk you through how to parse the JSON output data from Singer using target-csv and standardize it using a simple Python script.

Source: unDraw

Notes

The code for these examples is available publicly on GitHub here, along with descriptions that mirror the information I’ll walk you through.

These samples rely on a few open source Python packages:


The growing debate over the viability of building on open source Singer taps

Singer is an open-source standard for writing scripts that move data built by the folks over at Stitch. The open source project was introduced by Stitch to make the process of creating data integration “connectors” more standardized and easy — an attractive pull for developers.

Source: unDraw

In fact, both closed source projects like hotglue and open source projects like Meltano are building off Singer taps to offer platforms that make the process of creating data integration pipelines easier for developers.

However, there is a growing debate over the feasibility of building data pipelines on top of Singer taps. Why?

Airbyte, a…


An embeddable data integration tool for B2B developers built on the Python ecosystem — now in open beta!

Hello from the hotglue team! This is part of an ongoing series of posts where we keep track of our updates and milestones. You can also follow us more closely on IndieHackers!

What is hotglue?

A quick refresher for those who aren’t familiar with hotglue: we make a data integration tool to get customer data into B2B apps.

Our software embeds into apps, enabling developers to support more data sources, manage data cleansing & transformation, and offer a self-serve experience to their users. With hotglue, any developer can build a data integration pipeline in minutes without months of development and maintenance.

Updated demo

We’d love…

Hassan Syyid

Co-founder of hotglue

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store