Have two databases with the same table schema and need to keep both up to date? First, let us look at the differences between the two databases. The query below will show the differences between the development database table tbl_zip_code and the production database table tbl_zip_code. Ideally the differences should…
Category: Code
This area of the site is dedicated to code snippets for quick and easy reference
Useful CSVKit Commands
References: https://csvkit.readthedocs.org http://www.anthonydebarros.com/2011/09/11/csvkit-data-files/ https://jonlabelle.com/snippets/view/shell/csvkit-commands http://jeroenjanssens.com/2013/09/19/seven-command-line-tools-for-data-science.html http://csvkit.readthedocs.org/en/latest/tutorial/3_power_tools.html https://csvkit.readthedocs.org/en/0.9.1/scripts/csvclean.html
Install CSVKit
I personally use Ubuntu, if you don’t the commands may be slightly different. To install:
Ubuntu Web Development Server
This is a project I’ve been meaning to rewrite, as I get it going I’ll add screen shots and examples but for now I’ll work on the shell scripts After installing base Ubuntu, set the root/sudo password so you can do installs cleaner. After the below you will asked for…
PowerShell – CSV Columns and Character Count
Reference: http://stackoverflow.com/questions/8685034/error-importing-5-gig-file-into-table
NPI Database
If you work in medical databases you are likely familiar with the site CMS NPI Search I have had a few projects that need the ability to validate NPI numbers so based on data at CMS.gov I have worked out a solution to get the data into a database that…
LinkedIn API – Full Profile Details
Using LinkedIn API Console this URL will provide full profile details XML https://api.linkedin.com/v1/people/~:(id,first-name,last-name,headline,picture-url,industry,summary,specialties,positions:(id,title,summary,start-date,end-date,is-current,company:(id,name,type,size,industry,ticker)),educations:(id,school-name,field-of-study,start-date,end-date,degree,activities,notes),associations,interests,num-recommenders,date-of-birth,publications:(id,title,publisher:(name),authors:(id,name),date,url,summary),patents:(id,title,summary,number,status:(id,name),office:(name),inventors:(id,name),date,url),languages:(id,language:(name),proficiency:(level,name)),skills:(id,skill:(name)),certifications:(id,name,authority:(name),number,start-date,end-date),courses:(id,name,number),recommendations-received:(id,recommendation-type,recommendation-text,recommender),honors-awards,three-current-positions,three-past-positions,volunteer)?format=xml JSON https://api.linkedin.com/v1/people/~:(id,first-name,last-name,headline,picture-url,industry,summary,specialties,positions:(id,title,summary,start-date,end-date,is-current,company:(id,name,type,size,industry,ticker)),educations:(id,school-name,field-of-study,start-date,end-date,degree,activities,notes),associations,interests,num-recommenders,date-of-birth,publications:(id,title,publisher:(name),authors:(id,name),date,url,summary),patents:(id,title,summary,number,status:(id,name),office:(name),inventors:(id,name),date,url),languages:(id,language:(name),proficiency:(level,name)),skills:(id,skill:(name)),certifications:(id,name,authority:(name),number,start-date,end-date),courses:(id,name,number),recommendations-received:(id,recommendation-type,recommendation-text,recommender),honors-awards,three-current-positions,three-past-positions,volunteer)?format=json