Rich Data Services (or RDS) is a suite of REST APIs designed by Metadata Technology North America (MTNA) to meet various needs for data engineers, managers, custodians, and consumers. RDS provides a range of services including data profiling, mapping, transformation, validation, ingestion, and dissemination. For more information about each of these APIs and how you can incorporate or consume them as part of your work flow please visit the MTNA website.
RDS-JS is TypeScript/JavaScript library to simplify and faciliate interacting with any given RDS API. By using this SDK you will add to your project the benefit of strong types and easy to use helper functions that directly reflect the RDS API.
Make RDS queries easy. Write strongly typed code. Use RDS-JS.
RDS SDK Documentation | RDS API Documentation | Examples | Contributing | Developer Documentation | Changelog |
---|
Install the sdk into your project.
npm install @rds/sdk
import { RdsServer, RdsCatalog, RdsDataProduct } from '@rds/sdk';
// Instantiate a new server to define where the RDS API is hosted.
const server = new RdsServer('https://covid19.richdataservices.com/rds');
// Instantiate a catalog that exists on the server
const catalog = new RdsCatalog(server, 'int');
// Instantiate a data product that exists on the catalog
const dataProduct = new RdsDataProduct(catalog, 'jhu_country');
These are the basic, foundational building blocks of the RDS SDK. From here, we can explore what catalogs/data products exist on the server, details about them, subset the data through various queries, and downloading customized data packages.
See the documentation for the full SDK API.
Represents a single RDS API server, provides methods to query server-level information.
Get the root catalog on the server
import { RdsServer } from '@rds/sdk';
const server = new RdsServer('https://covid19.richdataservices.com/rds');
server.getRootCatalog().then(res => console.log(`There are ${res.parsedBody.catalogs.length} catalogs on this server!`));
Represents a single catalog on a server, provides methods to query catalog related information.
Resolve properties about the catalog
import { RdsCatalog } from '@rds/sdk';
// Given a previously instantiated server, like in the examples above
const catalog = new RdsCatalog(server, 'int');
catalog
.resolve()
.then(()=>
catalog.name; // Name of catalog
catalog.description; // Catalog description
catalog.dataProducts; // All the data products on this catalog
// See the docs for all the possible properties
);
Represents a single data product within a catalog, provides methods to query data product related information.
Run a select query to get record level microdata.
import { AmchartsDataSet, HttpResponse, RdsDataProduct, RdsSelectParameters } from '@rds/sdk';
// Given the catalog from the above examples
const dataProduct = new RdsDataProduct(catalog, 'jhu_country');
// Specify some parameters
const params: RdsSelectParameters = {
cols: 'date_stamp,cnt_confirmed,cnt_death,cnt_recovered',
where: '(iso3166_1=US)',
metadata: true,
limit: 5000,
format: 'amcharts'
};
dataProduct.select<AmchartsDataSet>(params).then((res: HttpResponse<AmchartsDataSet>) => {
/* Make a cool visualization */
});
Run a tabulation to get aggregate level data about the dimensions and measures specified.
import { PlotlyDataSet, HttpResponse, RdsDataProduct, RdsTabulateParameters } from '@rds/sdk';
// Given the catalog from the above examples
const dataProduct = new RdsDataProduct(catalog, 'jhu_country');
// Specify some parameters
const params: RdsTabulateParameters = {
dims: 'date_stamp,iso3166_1',
measure: 'cnt_confirmed:SUM(cnt_confirmed)',
where: '(year_stamp=2020) AND (iso3166_1=US OR iso3166_1=CA OR iso3166_1=ES OR iso3166_1=IT OR iso3166_1=CN)',
orderby: 'date_stamp ASC,iso3166_1 ASC',
metadata: true,
inject: true,
totals: true,
format: 'plotly_heatmap'
};
dataProduct.tabulate<PlotlyDataSet>(params).then((res: HttpResponse<PlotlyDataSet>) => {
/* Make a cool visualization */
});
Putting this product together and maintaining the repository takes time and resources. We welcome your support in any shape or form, in particular:
the url to parse
the parsed url
Serialize a parameter that has an array of values into a url query parameter.
parameter name
array of parameter values
url query parameter
Serialize a parameter that has a primative value type into a url query parameter.
parameter name
paramter value
url query parameter
Serialize RDS query parameter to url query parameters
parameters to serialize
url query parameters
Generated using TypeDoc
This function creates a new anchor element and uses location properties (inherent) to get the desired URL data. Some String operations are used (to normalize results across browsers).
References JS implementation from https://j11y.io/javascript/parsing-urls-with-the-dom/
const myURL = _parseUrl('http://abc.com:8080/dir/index.html?id=255&m=hello#top'); myURL.source; // = 'http://abc.com:8080/dir/index.html?id=255&m=hello#top' myURL.protocol; // = 'http' myURL.host; // = 'abc.com' myURL.port; // = '8080' myURL.path; // = '/dir/index.html' myURL.segments; // = Array = ['dir', 'index.html'] myURL.query; // = '?id=255&m=hello' myURL.params; // = Object = { id: 255, m: hello } myURL.hash; // = 'top'