Tag Archives: tips

Establishing the storyline


One of the first things that both the supervisors and the research students need to remember is that although the dissertation is the justification of an academic thesis, it also needs to tell a good and convincing story. There is little point in making a wonderful discovery if you cannot properly communicate with other people to tell them about it. Research is about discovering something unknown, and like any good mystery story, there needs to be an introduction to set the scene for your readers, (the literature review) there needs to be a storyline to develop the research agenda (starting with the methodology) there need to be clues discovered as the story develops (the results chapter(s)) and there needs to be a moment of final revelation of the object of your search (the analysis and conclusions).

The delivery of this story requires a certain writing style – it needs to follow the academic conventions of the subject discipline, it is not a novel – but that should not mean that the ‘story’ that the researcher wants to tell should not be easy to read. There are some simple tips, such as to first lay-out using numbered sub-headings, the main headlines in the ‘story’. The separate sections can then be written under these headings and linked together to form the chapters. A good idea is to begin by drafting the contents page of the dissertation, listing the chapter headings (1. Literature Review, 2. Methodology… etc.) and then entering the various headings of likely sub-sections. In addition to helping to establish a coherent storyline (which can be amended as the writing progresses) this enables the dissertation to be written in a manner which is not necessarily linear (sub-sections can be skipped and returned to a later date) and built up piece-by-piece while still keeping within the framework of the story. It is also a good tool for discussions between the research student and the supervisor about stage-by-stage progress (I have used this with red (not-done) green (completed) and amber (working on it) highlights, to help students prioritise what bits of writing need to be tackled next).

The bottom line is that the research student needs to craft a good story to introduce, explain, and discuss their research project, and if this is easy to read, then it will be easier for readers to follow and perhaps build-upon in subsequent activities. This includes correct spelling, good grammar, and simple tactics such as to avoid l-o-n-g and cumbersome sentences (I had once student who wrote a sentence containing the word ‘and’ seven times! This really was three separate sentences and would have been far easier to understand if it had been written in a simpler style.) Another avoidable error is to include sentences which give ambiguous comments. If there is a way in which your comments can be misinterpreted, it is human nature that someone will take the wrong meaning, and this can be easily avoided by actually saying what you really mean, and keeping this in simple language that cannot be misunderstood. Using hierarchical numbering for the chapters, sections, and sub-sections not only helps to create a clear storyline, it also helps to allow cross-reference to earlier (or future) comments in the dissertation.

It is the role of the research supervisor to read and give comments to help improve the direction of the writing process. The student does not need to like these comments (and indeed, at their own risk, may chose to ignore them) but they should heed them because it is the duty of the supervisor to direct the work of the student to ensure that they give the very best presentation possible of their work for examination and further scrutiny.


How to Illustrate your results


When I was writing up my own PhD (in the antediluvian days before personal computers, desktop publishing software, or graphics packages!) I was given a very useful lesson by the Prof. who was my supervisor. I was agonising about how good my hand-drawn graphs and maps needed to be, how precise the individual, hand-printed, iron-on lettering needed to look. He informed me, rather drily, for that was his preferred style, that I was “… training to be a geologist, not a draughtsman!

From that response I understood, correctly, that if my diagrams are clear and accurate enough to convey my key point(s) then a point of diminishing returns is quickly reached on the time spent labouring over them. There is no need to produce a “work of art” – it is about “communication”. The situation is slightly different now, for there are lots of clever software packages, in Excel and elsewhere, which can quickly produce lots of impressive diagrams which can be “cut-and-pasted” into the text with minimal effort – but the two fundamental points remain the same. Firstly, if the initial data is weak and/or disorganised, then any resulting illustration is hardly worth the effort of trying to interpret with any degree of real meaning. As computer programmers are taught early – GIGO – (Garbage in, garbage out)! Secondly, a diagram (or a map, or a graph) needs to convey something meaningful. It is a visual expression of something that the author is trying to convey to the reader, so if this can be communicated clearly and simply, that is sufficient. There are far too many elaborate diagrams that are over-designed, and the result can appear so complicated that it is the diagram, rather than the results, that needs to be explained to the reader.

In some subjects, there are more-or-less standard conventions for diagrammatic representations, such as histograms, bar-charts, tolerance diagrams, or pie-charts. It usually makes sense to abide by these conventions because it can help comparison with similar studies elsewhere. Usually, simple is best. Let the eloquence of the diagram communicate the data for you. Sometimes, particularly due to the speed and ease with which computer-generated diagrams can be generated, there can be a tendency to “graph every variable against every other variable” in the hope that a stunning correlation is unexpected revealed. While this can happen, it is more likely that simply a blinding flash of the obvious is revealed, without contributing anything more than confusion to the current understanding of the topic. As with the use of statistics, it is always better if the author actually understands what they are trying to do before attempting the activity. It is too easy to drop into the text a “pretty photograph” or a diagram of a rather obvious feature without actually conveying much real information (e.g. a pie-chart of the male/female split of respondents; it is probably better just to give the percentage figures).

In a few cases, the use of a few clever diagrams, such as fishnet images of topography, or bar-chart information superimposed on a map to show geographical abundance, can produce a stunningly visual interpretation, but these should be used sparingly. While it is true that a (good) picture can say a thousand words, the tokenistic use of photographs, diagrams, or graphs can simply clutter up the main text, and require further text to explain the image to the reader. A good illustration actually says something clearly and makes a positive contribution to help the reader understand the accompanying text and data.

Using statistics in research


For me, the golden, unbreakable rule is, never use any statistics if you do not really understand what they mean! This might seem obvious, but it is surprising how frequently statistics get misused or misinterpreted to support an argument that actually has no real basis in fact. The famous saying that there are three types of lies – “lies, damned lies, and statistics” is attributed to Prime Minister Disraeli, but when properly used, statistics can be clear, unequivocal, and very supportive in communicating complex data simply. The main problem(s) are often started by people deliberately selecting the information that they want to hear and then seeking for statistical back-up which looks impressive and difficult to challenge. Secondary problems occur when people either do not properly understand what the real statistics are saying, or when people choose to deliberately select or twist the statistical information which seems to support their preferred point of view. Ultimately, all three problem areas both devalue the use of statistics and also take us even further away from a clearer understanding of the situation that we are trying to interpret and communicate.

A good “rule of thumb” is to stick to the simplest means of statistically expressing the results that you want to communicate. Percentages, pie-charts, and histograms might look fairly unadventurous if you are trying to impress an examiner, but they have the advantage that they are quick to produce, clear to interpret, and easy to understand. Fancy calculations may look more impressive, but they are frequently harder to produce, more difficult to fully understand, and have a greater chance of either the creator or the reader making errors of interpretation. A common error is to quote percentages rather than give simple numerical values for small population samples. If 7 out of 12 of your interviewees agree, say “7 out of 12 agree that…” rather than “58.33%…” A difference of 1 person immediately gives an 8% error and is clumsier. Keeping it simple gives both a truer impression of the data and an easier comparison with other results. Similarly, I have seen some very impressive and complex diagrams, complete with 3-D shading and vector trends, which actually do not tell us very much at all because the detail is lost in the artistic flamboyance. They look fancy but add nothing to the discussion.

Quite often, certain disciplinary areas will have their own conventions as to which statistical procedures are common, or preferred, and how they are presented. The supervisors should be able to advise on these common standards, and the benefit is usually that the new research data can both make use of earlier research results, and can be easily contrasted and compared with already published data in the discipline. Some statistical procedures can look complicated to calculate, but are actually quite straightforward to use. All universities will have opportunities for research students to attend courses on statistical methods which are appropriate for different subject areas of research, so students should get training early in the research to avoid any subsequent false starts. There are lots of self-guide short courses on the web, and of course in text-books, but self-tuition is also open to misunderstanding, so it is always best, in the first exploration at least, to work through the procedure(s) alongside someone who is already very familiar with the statistical technique(s). Bear in mind, contrary to some current political rhetoric, there are no “alternative facts” simply facts that you acknowledge and facts that you might prefer to ignore. Research is about improving knowledge, not picking just the bits that you like.

Reportage or commentary?

wifi sign 

When the time comes to reveal your research results in writing, there are two basic choices, and the writer needs to decide upon one of them. Either the raw results are presented without embellishment, followed by a separate chapter on their analysis, or else the results can be presented alongside a running commentary or analysis. Both styles have merits and demerits and each academic discipline will have its own preferences and standards, so an important role of the supervisor is to coach the research student in the form that is conventional for that academic subject.

The straight presentation of results is a simple, clear, relatively uncomplicated option, which is subsequently followed by a chapter devoted to the analysis and interpretation of those results. Benefits of this style are that systematic links can be made with the research methodology, connecting the chronology of the data-gathering activities with the presentation of data that was gathered. This allows the reader to experience the research process in a similar manner to the researcher, stepping from one “result” to another and enabling the readers to form their own opinions and judgements as more and more information is presented. In the following chapter, the research student can then present an in-depth analysis of the results, drawing attention to key features, analysing the contrasts and connections, and finally presenting interpretations and conclusions of the research project. Separating the presentation of the results from the analysis allows a clean break in the narrative and gives the researcher a good opportunity to expound in detail in the analysis and interpretation chapter to convincingly present their own, original ideas. This is the chapter where the student can really shine and unload all those brilliant insights and personal observations that have been suppressed during the earlier phases of the research.

The other format of presentation, the running commentary, is a different style altogether. This form will also reveal the results of the research activities stage-by-stage, but with each revelation there is an accompanying narrative which explains and contextualises those results. The text is used to build-up the research data and an accompanying analysis of its relevance to the research question, and use this step-by-step process to bring the research project to a conclusion. This format requires clear thinking, because it is easy to stumble around from one idea to another and produce a disorganised story which is neither sufficiently analytical nor convincing. When it is done well, it can read like a good detective story, gripping the readers and leading them onwards through the research discoveries to the final exposé of “the solution” or “the answer” but it does not suit every style of academic research. It can be a useful style when the writer wants to discuss and elaborate on the data as it is presented, perhaps to emphasise social nuances, or to consider the wider possibilities of experimental assumptions, and in situations where the interpretation of the results is not a straight black-or-white solution.

Either style is acceptable, but they cannot really be effectively combined: the researcher needs to think carefully about the story that they want to leave with the readers, and then present this version as clearly and unambiguously as possible.

Starting to get results – Building the picture


Take a step backwards. Perhaps the most confusing part of any research project is when some results start to emerge – but this is also one of the most exciting stages. There are three main reactions to the early arrival of research data; firstly, delight that results are finally coming through, as evidence that progress is being made; secondly anxiety that the “correct” information is emerging; thirdly trepidation, if not outright confusion, in attempting to make some sense of the results. All of this happens in quick succession, perhaps even all at once! Hopefully, the cautionary approach to the main data-gathering phase by way of a short pilot study should at least give the research student some confidence that the right research questions were being asked. There may remain doubts that enough data has been gathered – enough interviews generated, enough experiments conducted, enough field investigations made – but the answer to this question will only appear when the research study runs its full course. Despite the temptation to gather AS MUCH data as possible, the experienced supervisor will caution the research student of two hidden dangers that lie in the shallows. One is to remember that gathering the data is only the first part of the story, and the more that is gathered the more there is to be recorded, collated, analysed, interpreted, archived, and all the other ancillary tasks that need to be accomplished in order to secure a robust research project. Secondly, is to recognise the obvious, but often neglected, reality that the quality of the data collected is much more important that the quantity. Gathering a huge mass of data is not much good if the wrong questions have been asked, if important considerations have been missed, or mistaken assumptions made at the earlier stages.

Assuming that the methodology is appropriate, and that the data-gathering methods were systematic, robust, and effective, then every researcher – whether engaged on a small project or a mammoth one – is faced with the same question. “So what does it all mean?” There often comes a natural limit when collecting research data – a point at which it becomes apparent that simply collecting more and more data is not going to substantially change the conclusions. A point of diminishing returns on effort expended. At this point, the “So what?” factor kicks in. It might be necessary to back-track and do some fine-tuning, perhaps to look at some small specific areas in greater detail, or to conduct some follow-up research to fill in some gaps. Perhaps there is a need to explore some adjacent research questions which are tangential to the main research question, but will hopefully provide a better context in which to consider it. Sometimes it helps to simply present the results, devoid of attempts at interpretation, to a few trusted colleagues such as supervisors, to obtain some feedback and get some reassurance on “Do these findings make any sense?” Or perhaps it is time to draw the data-gathering to a halt – even temporarily – and begin to re-assemble the results to piece together what pictures emerge. This is the time when simply getting all the research results down in a systematic, logical, readable form is the main task, and hopefully this will provide a new platform to analyse what the results actually mean.

Editing – deciding what to keep


Deciding what actually needs to be in the final version of the text in a dissertation or a journal paper can be a tough job. Some people do revision after revision, chopping and changing, cutting and adding, re-working the text until they are satisfied. Others (and I am one of them) usually think the subject through, then write the complete text straight off, only making minor changes later before submitting the final version. Whatever way works best for the author is the correct approach. The most important thing to remember is that whatever topic, the dissertation should tell a logical story to the reader. The role of the supervisor is often crucial at this stage, because the writer can frequently get so immersed in the subject matter that it can be difficult to see the wood for the trees. At worst, the writer wants to include everything that they know about the topic – just to be on the safe side. At the other extreme, the writer assumes that the readers understand how they are thinking, and tends to skip on the details, leading to ambiguity or misunderstanding by the readership. Having a “fresh pair of eyes” read over the text can be of immense value – whether it is a friend, a partner, or a supervisor, just having a colleague giving an unbiased view can help to iron out any possible areas for future confusion. Listen to them, and try not to be too defensive: if they have the courage to question you, listen to their opinions. Try not to be pedantic – verbosity and clarity rarely go well together – so consider carefully if your sentence actually contributes towards understanding the text, or is it just padding?

Usually, when writing something as chunky as a 100,000 word PhD dissertation, I would advise that each chapter or section should be drafted, then parked, until the general structure of the full text becomes more clear. Before starting to write the final chapter – the conclusions and any recommendations of the research – the author should pause, go back to the very start of the text, and re-read everything that they have written – making final amendments. Constructing complex narratives, such as dissertations or academic articles, need not be written in a completely linear fashion (i.e. from page one all the way through to the end) so re-visiting the advance draft gives an opportunity to shift paragraphs around, or add/delete information, and generally tidy up the text. This is also a good time to check that all the relevant citations to referenced evidence are included, as well as inserting accurate place-holders for tables, diagrams, and images. The advantage of pausing before starting the last chapter and finalising the earlier text, is that the “story” of the narrative is now fresh in the memory (it may have been a very long time since the author wrote the first few paragraphs of the dissertation). Basically, it is in the best interests of the writer that any readers can follow clearly and understandably the points that are being made. Spelling errors, overly-long sentences, clumsy wording, ambiguous statements, and a lack of referenced evidence all serve to make it more difficult for the reader to understand, and ultimately this reflects badly on the appreciation of the text. A happy reader means a happy examiner, and a better chance that the work will be more widely read and esteemed.

Giving feedback

Feedback sheets

For the supervisor, feedback is perhaps the most difficult aspect of the whole supervision process. The intention of feedback is to enable the recipient to benefit from critically helpful comments and suggestions, but a balance is often difficult to find. To put it simply, the supervisor wants to provide the student with helpful advice to enable the student to improve their performance, but to stop short of actually doing the work for the student. Viewed in this context, any feedback should consist of three parts; a note of what the student has done well; the identification of what can be improved; and suggestions for making these improvements. It is not sufficient to say that, “Your citations are terrible” without explaining how they can be improved. Simply listing the faults can be demoralising and is not sufficiently helpful for learning. Personally, I am not a big fan of the trend to include a “Feed-forward” paragraph, because I belong to the tradition that good feedback always includes within the commentary some instructions on how to make future work even better, so the need for a separate “feed-forward” section is redundant.

That is the broad context, but the level of detail that a student can expect to receive, and the timeliness of such feedback, can be very much case-by-case, and diverse according to different supervisors. When I receive the first pieces of writing from a student, as they complete drafts of individual chapters, I like to give a detailed root-and-branch response. Normally I do this by using track-changes, to insert every missing comma, correct spelling or clumsy grammar, and place annotations in the margin to query or compliment relevant sentences and diagrams. I appreciate that not every supervisor considers this to be part of their role, but I take the view that it is my job to set the benchmark of quality for the student in the presentation of their dissertation. To do this, I can only give them an idea of the standard of writing that I personally would be comfortable with if this was my own presentation. I do not tell the student what to write, but I encourage them by example to present this in the best and most appropriate manner. I work on the (possibly naïve) idea that every student wants to exert themselves to the highest standards possible, and therefore when I make suggestions on how to improve the work, these suggestions are made with the best intention to benefit the student. I leave the decision on whether or not to accept my changes and comments to the wisdom of the student. If s/he feels that their original version is better, that is their decision, but if the External Examiner demands the same changes that I have suggested, I know that it is not because the student has not been given that advice by me, merely that they have not chosen to heed it.

Timing is another variable issue. At my current university we are required that “normally” (a wonderful word) we are expected to return feedback to students within ten working days of the submission deadline, and I think this is fair. The purpose, after all, of feedback is to help the student to improve their future work, and this is best done while the submitted work is relatively fresh in their memory, and before the student starts make similar mistakes in the next piece of work to be submitted for assessment. In practice, with research students, ongoing feedback can be given in a variety of ways – written or verbal – using a diversity of media, including text, telephone support, chats in the corridor, and formal sessions either face-to-face or using video-chat. It is wise to explore very early in the supervision process what works best for the individual student and the individual supervisor.