Articles

Bulk importing Data into HBase

Posted by on

HBase is a NoSQL cluster system that has a different schema than relational databases, such as MySQL. One of our new products will need to load healthcare data in a relational format (MySQL) into HBase. Since HBase is an evolving technology, various methods exist for loading data from relational format into non-relational format. One such method is a tool called Scoop that automatically imports data between these formats, given schema of both source and destination. We did some in depth research on this tool and concluded it could work well if you have relational data.

  • Read More

Agile Process: A Brief Introduction

Posted by on

Traditionally, most software development has been done in an ad-hoc manner: in a code and fix style, and without a clear and consistent set of rules to drive the development effort. The ad-hoc manner has brought about chaos in the development process, leading to many problems that plague the software industry today. There have been countless cases of software failures that have sometimes proved to be fatal – largely attributable to a chaotic style of development. Owing to the lack of a consistent process, budget overruns and schedule overruns have been the norm in many software firms.

  • Read More

NoSQL Evaluation

Posted by on

NoSQL Database Solution Evaluation
We here at Deerwalk spend a lot of time working with data in various forms and consider ourselves experts in working within a relational database. With our deep experience in relational databases we have been very interested in the NoSQL movement and how we could apply that to some of the work we are doing with data.

  • Read More

Introduction to Non-Relational Data Storage using Hbase

Posted by on

Big Talk About BigTable

Relational Databases have hegemony on the way data has been stored. Proponents of Relational Database emphasize on normalization for valid reasons. Maintainability, Integrity (summed up in ACID) and Security has been the primary focus of classical relational database problems. Backed by Moore’s law it was easy to theorize that processing speed would inevitably be a trivial factor over other engineering problems like consistency and integrity. In some sense that is true but hitherto unaccounted for were sites like Google and Facebook which needed to process PetaBytes of data every second in real time.

  • Read More
  • Read More

Website development using Drupal – Cover Version control, Clean URL, Deployment

Posted by on

Drupal is one of the leading open-source Content Management Systems and it’s the technology that is favored by a range of numerous organizations worldwide. It is written in PHP and distributed under the GNU General Public License, which means anyone is free to download it, share it with others, and contribute changes back to the project. Drupal is an English rendering of the Dutch word “druppel”, which means “drop” (as in “a water droplet”).

Drupal can support a diverse range of web projects ranging from personal web logs to large community-driven sites. Drupal is very easy to set up and administer with much of the configuration done through the administration user interface. Drupal is frequently used for intra/inter-departmental intranet sites where individuals can post articles and other notifications rather than use email distribution lists. With its abundant and flexible features, Drupal design is conducive for a variety of websites.

  • Read More

Deerwalk Hike: Godavari-Lakuri Bhanjyang-Panuati

Posted by on

Winter had bid adieu to the valley and spring beckoned. The weather was perfect for a “short” hike from Godavari to Panauti via Lakuri Bhanjyang. We had tea and light snacks at a local restaurant at Godavari before we started our hike. The sun smiled down at us promising a great day ahead. Initially, we had steep ascent that passed through a wilderness of nature.

  • Read More

BDD: A cucumber recipe

Posted by on

Agile methodology is an incremental and iterative software development methodology. It tries to satisfy the customer through early and continuous delivery of valuable software, welcoming changes in the requirements even in the later stages of development. This methodology has been popular these days. Scrum and Extreme Programming (XP) are two well-known agile methodologies.

  • Read More

Deploying Custom Forms to Microsoft Office SharePoint Server

Posted by on

Applications need to collect data from users. SharePoint emphasizes ease of use for non technical users while providing a comprehensive API for programmers. This means a diversity of techniques that demand different levels of technical complexity and flexibility for design of forms. This article aims to introduce some of these techniques and evaluate them on different aspects like ease of deployment, security etc.

  • Read More

Mirth Connect Quick Start

Posted by on

HL7 can be said as the standard that has been set for data interchange in Healthcare systems. Mirth is an open source cross platform HL7 interface engine that enables bidirectional message sending. It eases the process of generating and sending messages over multiple transports. Mirth is distributed under the MPL 1 license. At Deerwalk we have had to communicate with many HL7 systems and have found Mirth to be a good framework for interfacing with HL7. We have noticed that there is not a lot of documentation on getting a Mirth solution up and running so we have built a quick start guide to using Mirth.

  • Read More