It's what you've all been waiting for! Let's continue on with our book review: In Chapter 8, the author discusses Math and Simulation functions in R. The topics in this chapter could fill a book given this is what R is primarily used for. However the a...
Recently I had to perform a procedure in which I counted the number of occurrences of certain, unique key words in a database where each record held text data. Here is my logic in psuedo-code: For each record in KeyWord_table -- unique keywords Ente...
I was flipping through my copy of William Cleveland’s The Elements of Graphing Data the other day; it’s a book worth revisiting. I’ve always liked Cleveland’s approach to visualization as statistical analysis. His quest to ground visualization principles in the context of human visual cognition (he called it “graphical perception”) generated useful advice for designing [...] Related posts: Good Graphs: Graphical Perception and Data Visualization Your Data is Never the…
I know “officially” data scientists all always work in “big data” environments with data in a remote database, streaming store or key-value system. But in day to day work Excel files and Excel export files get used a lot and cause a disproportionate amount of pain. I would like to make a plea to my [...] Related posts: Large Data Logistic Regression (with example Hadoop code) Added worked example to…
We have added a worked example to the README of our experimental logistic regression code. The Logistic codebase is designed to support experimentation on variations of logistic regression including: A pure Java implementation (thus directly usable in Java server environments). A simple multinomial implementation (that allows more than two possible result categories). The ability to [...] Related posts: Large Data Logistic Regression (with example Hadoop code) How robust is logistic…
It’s often the case that I want to write an R script that loops over multiple datasets, or different subsets of a large dataset, running the same procedure over them: generating plots, or fitting a model, perhaps. I set the script running and turn to another task, only to come back later and find the [...] Related posts: R annoyances Your Data is Never the Right Shape Survive R
The paper is a review of how to do software development for academics. I saw it via C. Titus Brown (who we have interviewed), he is also a co-author. How to write software (particularly for other people) is something that is under emphasized in many cu...
Today, I was chatting to a friend who is working on his Ph.D thesis which coincidently is about my favorite topic: campaign contributions. We discussed about analyzing probabilities of a particular group to grasp more money than the others, partic...
