How to review mock CATs

Everyone tells you that the value in taking mock CATs lies in analyzing them, and not just in mechanically taking them. How exactly does one analyze a mock CAT? Here is a simple guide

Check your percentile.
The starting point for any mock analysis is the percentile. Not because it is very relevant, but because it is impossible to ignore. So, go ahead, knock yourself out. Check the section-wise percentiles, stare long and hard at the numbers, extrapolate the percentiles from the last 3 mocks and see where they are going, imagine how high your overall percentile would be if only you could produce your best section performances in the same mock, give in to curiosity, triumphalism and envy by figuring out others' percentiles.

Do all this to get the damn thing out of the system. Now, ignore it and focus on something that can actually be useful. There are three parts to this -

1. Mocks have the best questions, learn how to solve all of these
Mocks are often seen merely as a tool for assessment and bench-marking rather than as a tool for learning. Mock CATs usually have the best questions, the ones that have an elaborate 6-minute solution while also having the elegant 1-minute solution. So, make it a habit to review the questions that have gone wrong, questions that you have skipped and then the ones that you got right as well. Very often, students ignore the ones they have gotten correct. If all your attempts were through the best approaches, chances are you would have attempted 5 more in each section. There is a learning angle to every mock CAT. Do not ignore this. As this article says, the mock CATs have quite a few Now-you-know questions.

This is why it is very important to pick a mock CAT provider who focuses on providing detailed solutions and helps with the thought process. In other words, have a look at the 2IIM mocks before you go looking elsewhere. :-)

2. Which 3 get kicked out, which ones get in?
After every mock, do a simple exercise to improve decision-making. Select at least three attempts from each section that you should have skipped, and replace these with three you should have attempted. In your first few mocks, you might even be able to select 5-6 questions in each section. The big gains in mocks come from improved decision-making; and you have to take a conscious effort to improve this. If you can reach your point where you cannot find more than 1 question in each section that you had incorrectly chosen to attempt, you can count yourself ready for the exam.

3. Topic-wise and timing-wise analysis
You should ask yourself a few questions similar to the ones given below -
How good is the hit-rate in Sentence Rearrangament? Was it worth doing the DI even after taking 15 minutes, did I at least get all 4 correct? Should I completely skip Sentence Elimination questions from now on? Did I get a Permutation Combination question wrong again? Should I completely dump this topic?

On the timing front, figure out when the fatigue errors creep in. All of us find that there are 2-3 questions where we cannot really fathom why we marked that stupid wrong choice in the first place. This is essentially down to fatigue. There is a spell of 15-20 minutes where not much gets done and errors creep in. Locate this spell, see when it usually happens and reduce it methodically.

On the timing front, it is important to know which type of question gets you the best marks/minute. You might easily attempt 3 RC passages accounting for 12 questions within 30 minutes. But if you get 6 of these wrong, that is effectively same as attempting only one RC and getting all questions correctly. Four correct answers in 30 minutes is a very poor return.

Mock CATs, Mock CAT percentiles, predictions etc

I am going to start with a series of quotes.

There are two ways of lying. One, not telling the truth; the other, making up Statistics. 

There are lies, damn lies, and statistics.

Statistics are used much like a drunk uses a lamppost: for support, not illumination.

Replace Statistics with Percentile analytics and this would fit in perfectly in the context of CAT. No matter how many fancy charts are shown, it is the responsibility of the students to not over-interpret the results. When you take a mock CAT, the review happens on three planks -

1) Learn better methods by looking at the solutions
2) Think about how you could have improved your attempts by selecting better questions.
3) Evaluate your percentile.

Of the three, the least useful is no 3 (probably also the most harmful). Because it is the least reliable. Almost all mock CAT providers use look-up tables to give percentile scores. Gone are the days where a mock CAT provider could get 10,000 people to beat themselves into a frenzy on a given Sunday to take a mock CAT at 100 god-forsaken locations in the Country.

These days, proctored CATs probably have a sample size in the range of 1% of CAT takers. These are likely to be the most serious, most experienced, most-driven of the CAT takers. So, the test providers "adjust" the look-up table to factor this in. In layman terms, this boils down to - they look at the actual numbers, feed in some other numbers, and pat themselves on the back.

So, the percentiles are fairly unpredictable. And contrary to what all the service providers claim, there is no way to back-verify that database. The only ones who will call a coaching institute and tell them that they scored a decent percentile are the ones who got a decent percentile. So, the reverse-verification process is bogus. So, no one actually knows whether any percentile number has a serious correlation with the actual numbers. There is way more anecdotal evidence to say that the percentile numbers are erratic, than to say that they are accurate.

I recently heard that there was a percentile predictor that predicts percentiles based on numbers you feed in based on the scores you have got on other exams (some of my students called me to give me an update on their predicted results.). I almost fell from my chair laughing. Students who believe that there is a scientific basis for this kind of predictor should re-examine their brains. This level of gullibility cannot be good for the body.

The thought process behind the predictor is as follows - Take three not scientifically proven indicators with no established proof from back-verification, define arbitrary weightages based on your genius to these, come up with a fourth metric and call it a prediction. And supposedly students are flocking to this predictor engine. No wonder soothsaying, tarot card reading are all flourishing industries in our Country. If smart, ambitious people can be made to believe there is such a thing called a percentile predictor, god save the masses.

Anxiety does strange things to the mind. Fretting and fuming about this exam makes you do all kinds of over-analysis. The mind needs something to cling on to, to feel that you are on the right track. Ergo, predictor.

Think of all the guys who have completed their MBAs from IIM A, B, C and think about how each of them would react if you said "percentile predictor" in their midst. I will give you a hint. I spoke to a bunch of them and the only common factor was laughter.

So, what should we do?

I am going to say something that is difficult to implement. The last 2-3 weeks, you must focus on three things

1. Chuck the percentiles. Seriously, chuck them. Forget about them. Banish them.

2. Focus on still being curious and not getting sucked into this pressure vortex. The first 2-3 mocks that you would have taken, you would have enjoyed grappling with the questions. Slowly, the pressure takes over and you stop having fun in the mocks. You are too worried about the score (and that damned percentile). The ones who crack this exam are the ones who are likely to look at a question and go "Wow. Super question. I think I will enjoy solving this". If that joie de vivre is gone, you should rekindle it.

3. Mentally prepare for a paper that is far simpler than your mocks. In our Country, the service providers have a feeling that to create a great mock CAT, you must make it very tough. So, they create phantom tough questions. CAT does not do that. Lot of students panic in a paper because it is way easier than all the mocks they have done. They have difficulty adjusting to the fact that they can attempt 34 questions in Quant in CAT, whereas they never managed more than 22 in any mock. Finding a paper that is easier than mocks can disorient you. You end up shooting for too less, end up adjusting too late, and end up with a just-miss scoreline.

We at 2IIM have resisted every urge to make our mocks tougher and fought tooth-and-nail to keep it representative. This is why good students can sometimes attempt 75-80 questions in our mocks. Remember, the very best ones can and will attempt that many in actual CAT. So, it is very important to keep in mind that the level of difficulty will not be outlandish. If you are really good, but have never attempted more than 60 questions overall in a CAT paper, how will you adjust on the day of the exam to have a crack at 84 questions?

Try your best to have some fun in the paper. be very zen and forget the percentile, and go in thinking "this exam is going to be easy". Best wishes for CAT.

CAT preparation - Is it ok to start preparation in June?

The short answer is Yes.

The syllabus covered for CAT is very straightforward. Maths syllabus is equivalent to what is seen in 6th to 9th standard text book, and basic reading comprehension and sentence structures in English. The exam is tough because the questions are very application-intensive and because there are ~2 lakh people fighting for ~6000-12000 good seats

An aspirant can start by June, comfortably finish all the portions by August, or latest early September, take 20 mock CATs and be ready for CAT by November. This exam is as much about momentum and intensity as it is about knowledge or application. The intensity with which one prepares in the last lap will be a bigger determinant than how long you have been poring over basic formulae.

So, why do people start 12-months before CAT?

This trend of starting 12 or 15-months before CAT started recently. When I took my CAT, we guys used to start preparing in August (reluctantly). Now, I took my CAT in 2000 and back then the CAT exam was in December. But even adjusting for that, we guys used to prepare for barely 3-3.5 months. But we threw in a lot in that final lap. Many of my friends hit 30 mock CATs before the exam. Back then 70% of preparation used to be about taking practice exams. (Most of us would have been shocked if someone had asked us to prepare for percentages for 5 weeks)

The most important driver for this change has been the development (over-development) of the test-preparation industry. It really helps the industry if college-goers start enrolling themselves for courses 12 or 18 months before the exam. Less than 5% of this brigade takes the exam seriously. Any trainer will tell you that the longer term batches are the worst preparing. Students start missing classes and denude themselves into believing that they are geared merely because they started very early. 12 months into the course, the average attendance levels are less than 10% and when the time is perfect for starting preparation, these long-term and uber-long term batches lose all momentum.


I am starting preparation now, what should be the plan?


To start with, do not tell yourself you dont have a chance because you are starting late. Cover topic by topic for maths for the next ~8 weeks. Read something for at least an hour each day. Spend 2-4 hours each week on DI and/or LR. Run this schedule for ~ 8weeks during which time you should have also taken 2-3 mock CATs. In this first phase, do not worry about time pressure, speed, overall percentiles, etc.

By middle of August, you would have seen most question types, and covered most topics in quant. From here on, take one mock CAT every week and fill whatever gap areas you have. Identify gap areas based on your own gut feel and from what the mock CATs tell you. Have this as the plan for the next 6 weeks. During this phase, you should start building intensity. Plan part tests and exercises in short bursts. Mix up topics and ensure that you avoid concentration lapses. You should create a package like 10 questions in Number Theory, 3 selected passages from Economist, TIME and NYtimes, one DI grid and one LR puzzle from the web in 45 minutes and test yourself at breakneck speed. This phase is like strengthening muscle by muscle before a tournament.

Final few weeks, take mock CAT, review mock CAT aggressively. Repeat. Fill gaps if they still crop up and be as relaxed as possible.

I started preparation last November, what should I do now?
This is quiet simple. Restart now. Create a plan to aggressively ramp up intensity.