Thursday, March 14, 2013

Survey Says



Some dog professionals use studies and surveys in an attempt to prove that one method, tool, training, activity, and so on is better than another as a whole (whether the study or survey came to their conclusion or not). Some money has been spent, granted or donated to design, create, test, sample, and compile this data.  I don't know how helpful these studies ultimately are to the cause they are designed to serve.   I do know that they open up useful dialog about dog training, especially amongst dog trainers, dog behaviorists, and veterinarians.  Then what happens is that the interested dog professionals turn their conclusions and the advice based on their conclusions to the dog owning public (in other words not professionals in the canine field), who will probably not refer back to the studies or probe to deeply into what they may or may not reveal.   Much like if you got to a tax professional, you may not feel the need to research the validity of the tax law a Certified Public Accountant is explaining to you.  They are professionals, and their clients pay for their professional opinion so that they do not have to do the research.  Many dog owners given information by a dog industry professional in the form of an online article are not going to necessarily second guess that information.  Sometimes in order to make the right informed decision, dog owners should investigate more thoroughly what "professionals" may be telling them.

Raw data can be analysed many ways and correctly (or incorrectly) support different conclusions.   I do not find results to always be black and white, glass half full, or glass half empty.   Unless you are dealing with compounds or chemicals measured exactly the same each time, a reliable and predictable can not be guaranteed when you are talking about living individual beings with varying environments, temperaments, and upbringings.  Not every child brought up with a privileged background is going to grow up to have the same career for instance or even have a positive relationship with their parents.  Even siblings growing up in the same environment react differently to the circumstances of their upbringing.    No study can determine the guaranteed correct way the best way to bring up a happy child that can be predictable among a large sampling of children.   Dogs are also living individuals who all have differing needs, temperaments, interests, activity levels, and varying behaviors that may cause problems for their human owners.   Surveys or studies do not necessarily and definitively suggest the absolute best path to take for any large population of individuals.


Let's take this study for example:
Made available 1/24/2009 by Meghan E. Herron, Frances S. Shofer, Ilana  R. Reisner
The purpose of this study was to "describe the frequency of use, the recommending source, and the owner reported effect on canine behaviour of interventions that owners of dogs with undesired behaviors had used on their dogs"(as quoted from this study linked above).


No conclusions were reached in the study per say.  At least after several readings, I could not find a conclusion, and so I believe this means no conclusion was made as to best "interventions" (this document's word for acts made toward a dog to reduce the incidents of undesired behavior, I believe).  The result section simply pulled out statistical data of what was sampled, but this was not correlated later on to identify who or what results correlated to things like breed, source of information, and so on that could be linked to the later tables and charts in any kind of meaningful way.  That being said, and because of this, I do believe the study supports that differing temperaments, breed characteristics in general, and owners all thrive by the use of the proper method.   That being that no one method is the proper method for a whole sample of populations.   However, that is my anecdotal conclusion of the results, and the authors came up with much of the same conclusions that were not a result of scientific data analysis alone or in conjunct or with other scientific and/or statistical data study.



Another trainer and behaviorist have pointed out the very obvious flaws in the "study" or survey as follows:
Smartdog's Weblog "That Dogma Won't Hunt"
Smartdog's Weblog "Dogma and Pony Show"


This article is not meant so much as to go into the flaws in the study, and there are many.  If those interest you, please see the first series of articles linked to above and entitled "Another trainer and behaviorist have pointed out the very obvious flaws in the "study" or survey."    There are more flaws than just these, but for the brevity of this article I won't go into the others just now.

What I found far more interesting was the numerical data conclusion (in a biased study or survey) that at least 40% of the population of dogs had been helped by methods that the survey is trying to focus the public away from.   By the way, one very obvious flaw in this study is that not one of the lists is a "method".  The other term that they use, "intervention" would be more accurate.  Training as an art does not use any one particular thing, and in the case of this list most professional dog trainers would not recommend some of these things ever.   This point just needed to be made before sharing the numerical data results with you in the form of percentages.
Pos
Neg
None
Total
% Pos
% Neg
% Non
Proof
Direct Confrontation Per Study:
Leash Correction
59
7
29
95
62%
7%
31%
100%
Choke Prong Pinch Collar
26
7
17
50
52%
14%
34%
100%
Muzzle
18
20
11
49
37%
41%
22%
100%
Force Release of Item
17
12
6
35
49%
34%
17%
100%
Alpha Roll
14
8
10
32
44%
25%
31%
100%
Force Down W Leash
17
3
8
28
61%
11%
29%
100%
Knee Dog  In Chest for Jumping
13
1
15
29
45%
3%
52%
100%
Hit or Kick Dog
3
9
14
26
12%
35%
54%
100%
Grab Jowls/Scruff
7
8
10
25
28%
32%
40%
100%
Dominance Down
10
5
6
21
48%
24%
29%
100%
Jab Dog in Neck With Fingers
8
0
10
18
44%
0%
56%
100%
Remote Activated Shock
6
4
4
14
43%
29%
29%
100%
Rub Nose in House Soiled Area
0
1
8
9
0%
11%
89%
100%
Bark Activated Shock
5
2
2
9
56%
22%
22%
100%
Subtotal Direct Confrontation Per Study
203
87
150
440
46%
20%
34%
100%
Indirect Confrontation Per Study:
Yell "no"
50
14
40
104
48%
13%
38%
100%
"Schht htt" Sound
26
1
45
72
36%
1%
63%
100%
"Stare Down"
16
11
20
47
34%
23%
43%
100%
Water Pistol/Spray Bottle
19
11
21
51
37%
22%
41%
100%
Verbal Reprimand for House Soiling
18
5
22
45
40%
11%
49%
100%
Force Exposure to Frightening Stimuli
6
4
10
20
30%
20%
50%
100%
Growl At Dog
5
9
8
22
23%
41%
36%
100%
Subtotal Confrontation Per Study:
140
55
166
361
39%
15%
46%
100%
Subtotal Direct and Indirect Confrontation
343
142
316
801
43%
18%
39%
100%
Reward Based Per Study:
Food Rewards
96
1
13
110
87%
1%
12%
100%
Sit for Everything
79
1
13
93
85%
1%
14%
100%
Food Stuffed Toys
48
1
28
77
62%
1%
36%
100%
Use Food to Trade for Item
53
1
8
62
85%
2%
13%
100%
"Look" or "Watch Me"
39
0
16
55
71%
0%
29%
100%
Clicker Training
20
1
10
31
65%
3%
32%
100%
Subtotal Reward Based Per Study:
335
5
88
428
78%
1%
21%
100%
Neutral:
Avoidance
72
1
20
93
77%
1%
22%
100%
Increase Exercise
66
1
29
96
69%
1%
30%
100%
Pheromones
3
1
20
24
13%
4%
83%
100%
Subtotal Neutral
141
3
69
213
66%
1%
32%
100%
Subtotal Reward Based and Neutral
476
8
157
641
74%
1%
24%
100%
Total All Sample Per Study
819
150
473
1442
57%
10%
33%
100%
Forty six percent of dogs, according to a biased study were helped by so called confrontation interventions (interventions are not methods, a dog training method is a process created and owned by a particular dog trainer sold through seminars and books and includes more than one type of "intervention" or actions).   Though even these numbers are curious.

If 74% of reward based interventions worked positively, then why are they involved in a study by behaviorists where these interventions failed?   Unfortunately there is no data on what the actual diagnosis thereafter was, or the success level.  In other words, were these clients then directed to so-called confrontational interventions?  Probably not considering where this study came from, and that the listing of confrontational interventions demonstrates a lack of understanding of basic dog training principles.

So much more I could say about this study, but the attached articles in the boxes above go into much detail about the flaws.   I find it particularly disturbing when other trainers, without any though or analysis, hold this study up as proof that it by the study or survey's own words does not prove.   This type of action presents to me more of an agenda to retain market share in training, where perhaps performance is a lacking.


Robin Katherine Rubin
Mannerly Mutts
http://www.mannerlymutts.com
http://mannerlymutts.blogspot.com (main blog address)
York Beach, Maine USA
207-809-6300
IACP Professional Member #1942
E-Touch Seminar Attendance Certification
Bedrock Training Method Three Day School Attendance Certificate
Companion Dog Title completed in June 2008 for Jack CD ILP159648 Doberman Male 4 years old. Owned, handled and trained by Robin Rubin (deceased on 12/23/2009 and forever carried forward in our hearts)
Companion Dog Title completed June 2010 for Bri CD American Staffordshire ILP159964 female of 8 years old. Owned by friends of Mannerly Mutts. Trained by Robin Rubin. Handled by Robert and Robin Rubin.
Companion Dog Title completed June 2010 for Magoo CD Great Dane WS 28720301 male of 4+years. Owned by friends and clients of Mannerly Mutts. Trained and handled by Robin Rubin.
Leon (aka Pamelot's Ogelthorpe) CGC owned and handled by Robert Rubin in November 2011 (2004-2012 will forever remain in our hearts) Red Doberman Pincher male WS10508601 of 7 years old.
Boris (aka DRU's Boris) CGC owned and handled by Robin Rubin in November 2011 (just Black Doberman Pincher male of 3+ years old.  (to be registered in UKC as he is a tripod)




I do not support the following organizations: People for the Ethical Treatment of Animals (PETA), Humane Society of the United States (HSUS), Truly Dog Friendly (TDF), No Shock Collar Coalition (NSCC), Association of Pet Dog Trainers (APDT) and IPDTA (International Positive Dog Trainers Association).

No comments: