Comparison of Data Projects and App Development projects

Comparison of Data Projects and App Development projects

In IT project every project is similar. However the Data Projects differ to a large extent than the conventional App development projects.

Mainly due to the fact the Data projects transform Datum plural - Data into information and in turn into knowledge. Data stored in storage should well interpreted whilst executing a Data related project unlike an App Development project.

WHY ??? Keep watching this space and follow the Blog queries are welcome

Big Data

BIG DATA is it BIG ?

BIG Data is the buzzword for last couple of years! Where are we going with it?
Data or Information come in 3 forms:

1) known knowns
2) unknown knowns
3) unknown unknowns

Big data  contributes in the 3rd category to a large extent with the help or huge sample size of data applying statistical algorithms and over structured and unstructured Data

Spreadsheets a BOON or Curse to Bi?

      I know I am opening a topic where I may get skewed views on the topic. But i guess this is one of the basis for Bi. The Higher Management and most of the end users tend to have a good hand over Spreadsheets. And have to make the decisions at higher levels. Just as the famous saying 'The Devil lies in the DETAIL' when it comes to analysing the data at finer level and making the most of Bi from the data available data appropriate Bi tools are the best bets.

    

      People who have been working in the Business Intelligence delivery area would strongly agree that Spreadsheets are good to an extent of MIS, and Reporting purpose but not really tend to deliver the most for analytical reporting which is the main objective of Bi.

    

      It’s very common scenario; Inspite of the best analytical and Bi tools present in the organisations the end users make an effort to derive analytical information through spreadsheets which are really more suited for standalone reporting and aggregate reporting.

  

      In short; If you want to derive the most from Business intelligence initiative. Bi tools have to be used considerably, the more you use the more value reaped from the Data available within the organisation. 

Historical Big Data in Organisations.

Historical Data, commonly also referred to Big Data is all about finding a needle of value in a haystack of unstructured information. Organisations are now investing in solutions that interpret consumer behaviour, detect fraud, and even predict the future! McKinsey recently released a report stating that leading companies are using big data analytics to gain competitive advantage. They predict a 60% margin increase for retail companies who are able to harvest the power of big data.

To support these new analytics, IT strategies are mushrooming, the newest techniques and building data mining solutions. New data discovery techniques include spectacular visualization tools and interactive semantic query experiences.

Knowledge workers, analyst and data scientists sift through filtered data asking one unrelated explorative question after another.

The real industry challenge is to integrate Big Data it into mainstream IT.

The following Initiatives are outcome of mitigating Operational Risks in Finance and Insurance industry which are a derivative of historical data:

•   BASEL – II/III – A widespread initiative in EU Finance/banking Industry.
•  Solvency II - An Insurance Industry initiative.

  

Agile Development and Bi Solution

      
     Recently I have been experiencing enterprises opting for agile delivery, for a Bi Solution.  Does Agile delivery suit a Bi Solution ?
    
      Business Intelligence helps the organisation/Enterprise to be on its toes. The KPI's cease to deliver the invaluable information over a course of time. Hence the KPI's are refined/revisited from time to time. This is overcome by Agile delivery of Bi Solution.
     
      Agile Delivery is not only applicable to Business Process in Bi; it in-turn also results in Agile Development Bi Cycle made up of Releases. The Agile Delopment Delivery method is another important topic which I would cover  in my latter post
     
     In the current dynamic and economic times of competitive edge. Agile delivery method offers significant value for a Business Intelligence Programme for a Enterprise.

Following are some good refernce books for Agile Development Methodology:

Succeeding with Agile: Software Development Using Scrum
Agile Product Management with Scrum: Creating Products That Customers Love
Agile Software Development, Principles, Patterns, and Practices

ODS, Datamart OR Datawarehouse for Bi ?

        

      Recently, had a Query Regarding ODS, Datamart or a Datawarehouse?

And it was backed having as datawarehouse is the best. But my  Call was IT DEPENDS,yes Indeed it just Depends. Further analysis led us to a Campaign managment System built  over an ODS - operational Data Store.

       These different systems are built for specific purpose to meet the objectives. They absolutely address different purpose in their own way.

Following are the examples where these systems should be Build.

 ODS - possibly for Call Centres or CRM systems having a recent snapshot of the Data

 Datamart - Historical Data for a Department in Enterprise viz. Sales, marketing, Risk

 Datawarehouse - These systems are Built with a purpose to provide a picture of the Enterprise with respect to time based on factual data.

      A CRM and a Campaign management programme could be a derivative of any of the above; as stated earlier, depending what are the KPI's and Objectives of the Project.

      Hence objectives of the Project and KPI's after distilling the requirements are responsible for choosing the right system to serve the organisation.

Business Intelligence & Day to Day life - 02

What is the foundation of Business Intelligence ?

       Firstly, Historical Data wihin the organisation forms the main basis of Business Intelligence Initiative in an organisation. However the sponsorer and Analysts are the key drivers for making the Business better hecne the organisation should consider the following:

- Visionary Analysts and Strong Sponserer.
- Vigilant team Business team to maintain the competitive edge.
- Tech Savvy Technology Enterprise Arch. Group.
- Experienced/Vigilant Team forms the core of a Successful Bi Delivery.