Marlisa Griffin, MPA
Emerging Analyst and Leader
Introduction
Over my Bush School career, I have learned about several analytical strategies. Nevertheless, the more research I am involved in, the clearer it becomes that no analytical method is perfect. Matter of fact, even if a combination of analytical strategies is used, there will still be gaps in the analysis. In my professional and educational experience, people generally view quantitative data analysis as more accurate and objective. However, I have learned that quantitative analysis rarely explains why a relationship exists – a question that naturally follows after discovering a phenomenon. Qualitative analysis, on the other hand, can help explain why the relationship exists. However, qualitative analysis has its limitations and time constraints rarely allow it to be perfect. Thus, I have learned it is important to prioritize research questions, identify which analytical strategy best answers those research questions, determine the limitations of that strategy, and assess whether that strategy is still defensible.
Data Analysis

Quantitative Analysis: Professional Development Project
As an Administrative Assistant, one of the projects I was responsible for assisting with was a professional development survey. My role was to help develop survey questions to determine where the department’s training funds should be targeted, analyze the data, and create a report with recommendations. One of the lessons I learned during this project was that quantitative analysis can be beneficial for determining whether there is a relationship between variables and the magnitude of the relationship. However, quantitative data cannot explain why the relationship exists. For instance, although we could determine that the staff had an interest and knowledge in certain tools and technologies, we were not able to determine why they had particular interests or why their comfort level in a particular tool or technology was low. Thus, while quantitative data can be insightful and incredibly valuable, it is important to remember its limitations when using it for decision-making purposes.
Mixed Methods Analysis: Cost Efficiency Project
Furthermore, I learned, even if one can concoct the perfect research design, things such as time constraints prevent the design from being fully implemented. Thus, it is important to determine what the goal is and what trade-offs can be made, while still meeting the goal. Previously, a team and I encountered the challenge of determining a feasible but defensible random sample. Statistically speaking, a valid test sample for the population we were examining would have been approximately 350 test subjects. However, it was not possible to manually pull the data, analyze it, and report on it within a reasonable time frame for this number. The data simply was not organized well enough to facilitate this.
Because we recognized these limitations, we focused on relying on the insight from interviews to help us evaluate cost effectiveness. By identifying discrepancies between what interviews revealed, we could determine what areas deserved further examination. Additionally, we pulled a random sample of 35 items and determined which claims were substantiated in the data. Analyzing data this way did not allow us to understand the magnitude of the impact discrepancies had on cost effectiveness. However, it did allow us to determine an inefficiency that inflated costs existed. Therefore, we determined that we were willing to make a trade-off in determining the magnitude of this inefficiency due to time constraints because we had identified an inefficiency worth noting.
Conclusion
Although classes train you using an idealized research model, I have learned no research project will be perfect. There will always be limitations to each design. However, understanding the idealized research model helps you identify limitations more easily. Furthermore, while quantitative data can be insightful, it is important to recall that it also has its limitations – especially since it cannot explain why relationships exist. Additionally, time limitations can prevent one from enacting an ideal research plan that includes both quantitative and qualitative analysis. However, it is important to remember the research question and determine what analytical strategy helps answer the question. Although there are things that are nice to know about the data, it is important to be able to identify what is necessary and optional to assist with making trade-offs in research design.
Source: Ken Teegardin Flickr Creative Commons