Algemeen/Onderzoeksmethoden 2/het werk/2011-12/Group 1/results/comparison
Inhoud
Table
Concept | RWS | HK | JB |
---|---|---|---|
Assets |
|
|
|
Communication |
Words relevant to the meaning of "communication"
Words and phrases expressing content of communication
|
|
|
Structure |
|
|
|
Task |
|
|
|
Goal |
|
|
|
Hierarchy |
|
|
|
Processes |
|
|
|
discussion
When we look at the table we see that the content of the concepts is very different for the different interviewees. This could be due to the fact that the interviewees use different mental models and a different vocabulary to discus the topics but we suspect that part of the differences are attributable to the fact that the coding is done by different coders. One of the clues for a different way of coding is the fact that some of us have started out coding sentences or larger chunks of text and another has immediately coded words. This is visible when you look at the codes in the linked documents where you see the codes in the transcribed text. We all produced lists of words or phrases but still we expect the difference in approach to have had effects on these lists. Another clue is that when reading the content of the codes of others we found that there were elements in our transcript that we could have been coded under a certain concept but didn't because we didn't see the relevance.
All this said. it is still interesting to have look at the results and compare aspects of the lists that we think are comparable.
Assets
The lists for assets are relatively close to each other. They mainly contain examples of assets. we see that all three interviewees have examples of running software or information systems as assets. Also people or their capabilities feature in all three lists. There are differences. The only one that considered an organisation an asset was HK. It would be interesting to see if this was still true when the other coders had another look at their work, knowing this.
Communication
These lists are very different. One of them is very long and one of them very short. That is the first obvious differect. It could be the case that in one interview a lot was said on communication and in the other only a little.
Lets have look at what is in the lists. In both the RWS list and the HK list there are elements that are there because they refer to topics of communications. For instance "what is going on" (RWS) or "better solutions" (HK). In the JB list only means of communication are included.
Structure
Another example of very different lists. One of the issues may be that we have overlapping codes. "Structure" contains both "process" and "hierarchy". Some of the content that has been been coded under hierarchy in the RWS list would have been better placed in the Structure list. This would account for part of the difference between the RWS and HK list.
In the JB list there are two letters that stand for names of companies and so are instances of wholes. This only looks different but both of the other lists have references to instances of "organisation" so this is not really different.
A difference that could be attributable to the different model that the interviewee was using while talking is the fact that in the HK and RWS lists there is talk of groups and departments and in the JB list there is talk of people working for the company. This could be a reflection of the fact that the first two work for a very large organisation (the radboud university) and the other is leading a small company with only a few people working for it.
Task
In these lists elements that could be labelled as task type form the bulk of the list. This goes for all three lists. clearly, talking about tasks examples of tasks were abundant. It is not surprising that HK and RWS have overlapping sets of task types since they fulfill the same kind of functions in the same organization. It is also not surprising that the task types (or names of them) mentioned in the JB list are different since his work environment and his function is very different.
Another element that we see in all three list is the statement of some kind of relation to a task. "what i have to do", "a lot of work to do", "work on", "what to do".
Another thing that showed was that both RWS and HK seem to consider fulfilling a role to be the same as or asking to having a task.
Goal
Goal is represented both by the goal of an organization and goals of people working in organization. For example, JB, as a owner of a company, put organizational goals on the first place, and others consider their tasks as primary goals.
For people "web design" and "making customer happy" are goals. So tasks and the result are blended together in their vocabulary to represent the essential of their work.
In the coding of HK both words describing a goal and achieving a goal are coded. This is also because he discussed a more general goal of working at a university, compared to talking about the goal of his specific job. This makes sense because there is a big variety of positions at a university, compared to a marketing company for example.
Hierarchy
In all three lists for "hierarchy" there are words for boss. In the RWS list there is only one. It could be good to check if this is due to sloppy coding or really is a reflection of what was said in the conversation. The words used by HK and JB for boss are different and probably so because they work in a different environment.
Another thing shared by all three was the reference to levels: "flat", "higher", "two levels", "level", "above". We think it is safe to say that these people share "level" as a central element of the meaning of hierarchy.
Something that RWS and HK shared but JB not was the mention of formality as an aspect of hierarchy.
Processes
From the given lists it is not particularly clear whether we actually have words describing processes and that the words just happen to be similar to words using in tasks and communication, or that this similarity comes from the way we coded it.
We believe that processes are very close to tasks but also has elements of communication and goals. This is probably where the big difference between the list comes from (a more or a less strict distinction between the subjects by the coder). Maybe the category does not actually add any new information than combining other categories.
General
In general we can say that it could be a good idea to do another round of coding and also more explicit comments to relate a word or phrase to the code.
For example: in the RWS list for communication there is a phrase "be in the same room". This is under the code communication because in the conversation this was is considered something that is relevant for communication. "The connection of "be in the same room" to "communication" is very different than the connection of "talk" to "communication". To talk is an example of communication.
Another round of coding could have made the different lists better comparable. Implicit in the discussion of the lists for the concepts "task" ([tasktype] and [relation to task]) and "hierarchy" ([bos-underling], [formal-informal], [level]) is such a labelling and we can see that the comparison is much more fruitful there. It could also make differences in coding visible and make focussed checks possible. A new round of coding should also reduce the difference between actual instances (for example "writing many papers" as a goal) and more generic concepts (like "reaching" in goal).
Another general observation is that for most concepts the JB lists are smaller. Instead of attributing this to a different way of coding much of this could be attributed to the fact that the interview was shorter and part of the recording was lost.
During the discussion of the lists we could see that there are indeed some problems with intercoder reliability but also that for some concepts clear differences in wording were to seen and for instance for hierarchy it became very clear that the concepts of levels in the organisation was element for all three interviewees. This gives us an idea of what kind of results we could expect next time (with coding manual).