add about:telemetry and a bit more on user studies
[slides.git] / fosdem2016 / index.html
1 <!DOCTYPE html>
2 <html>
3 <head>
4   <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
5   <meta name="Author" content="KaiRo - Robert Kaiser">
6   <title>Data Improving Firefox</title>
7   <link rel="stylesheet" type="text/css" href="slides.css">
8   <script type="text/javascript" src="slides.js"></script>
9   <link rel="contents" href="#index" title="Overview">
10   <link rel="index" id="link-toc" href="#toc" title="Contents">
11   <link rel="start" id="link-start" href="#index" title="Start">
12 </head>
13 <body onload="docLoaded();">
14 <header id="header"><div id="header-text">Data</div>
15   <div id="subheader-text"></div>
16   <a id="headerlogo" href="#index" title="Startseite">Mozilla</a>
17 </header>
18 <nav id="slidenav">
19   <a href="#toc" id="nav-toc" accesskey="t">toc</a> ||
20   <a href="#index" id="nav-start" accesskey="s">start</a> ||
21   <a href="#" id="nav-prev" accesskey="p" hidden>&lt; back</a>
22   <span id="nav-prev-nolink" class="nolink">&lt; back</span> |
23   <a href="#" id="nav-next" id="goNext" accesskey="n" hidden>fwd &gt;</a>
24   <span id="nav-next-nolink" class="nolink">fwd &gt;</span>
25 </nav>
26
27 <article id="toc" title="Table of Contents">
28 <h1>Table of Contents</h1>
29 <h2>How Your Data Helps to Improve Firefox</h2>
30
31 <div class="captionedbox">
32 <p class="captionedbox-caption">The following slides are available in this presentation:</p>
33 <div class="captionedbox-content">
34 <ul id="toc-list">
35 </ul>
36 </article>
37
38 <article id="index" title="Start Page">
39 <h1>How Your Data Helps to Improve Firefox</h1>
40 <h2>Sending crash reports (and other info) pays off!</h2>
41
42 <div class="simplebox">
43 <mark><a href="http://home.kairo.at/">Robert Kaiser</a></mark>,
44 "KaiRo" &lt;kairo@kairo.at&gt;
45 <br><small>Program Manager, Mozilla QA</small>
46 </div>
47
48 <div class="captionedbox">
49 <p class="captionedbox-caption">Slides:
50   <a href="http://slides.kairo.at/fosdem2016/">http://slides.kairo.at/fosdem2016/</a></p>
51 <div class="captionedbox-content small">
52 <ul class="small">
53   <li>Created for
54     <a href="http://fosdem.org/2016/schedule/track/mozilla/">Mozilla
55     Developer Room</a> at <a href="http://www.fosdem.org/">FOSDEM 2016</a> in
56     Brussels.</li>
57   <li>Written in HTML 5 with CSS 3 and JavaScript.</li>
58   <li>Navigation via links on all slides, via access keys
59    (e.g. "n"/Alt+Shift+N for "next") or back/forward arrow keys</li>
60   <li><a href="#toc">Contents</a></li>
61   <li><a rel="license" href="http://creativecommons.org/licenses/by-sa/3.0/at/"><img
62         alt="Licensed under CC-BY-SA," style="border-width:0;vertical-align:bottom;"
63         src="cc-by-sa-80x15.png"></a> 01/2016 Robert Kaiser -
64     "Mozilla", "Firefox" and their logos are
65     <a href="http://www.mozilla.org/foundation/trademarks/list.html">trademarks
66     of the Mozilla Foundation</a>; <a href="http://www.startrek.com/">Star Trek</a>
67     and related items are trademarks of
68     <a href="http://www.paramount.com/">Paramount Pictures</a>.</li>
69 </ul>
70 </div>
71 </div>
72 </article>
73
74 <article id="data" title="Data Talk">
75 <div class="simplebox">
76 <h1 class="cent" style="position: relative; z-index: 3; color: #FFFFFF; font-size: 2.5em;">Let's talk about Data</h1>
77 <img src="mister_tricorder.jpg" class="sshot"
78      style="width: 100%; margin-top: -4.5em; position: relative; z-index: 1;"
79      alt="Data &amp; Mister Tricorder">
80 </div>
81 </article>
82
83 <article id="privacy" title="Data Privacy">
84 <h1>Data Privacy</h1>
85
86 <div class="simplebox">
87 <p>Principles: <a href="https://www.mozilla.org/en-US/privacy/principles/">mozilla.org/privacy/principles</a></p>
88 <ol>
89   <li>No surprises</li>
90   <li>User control</li>
91   <li>Limited data</li>
92   <li>Sensible settings</li>
93   <li>Defense in depth</li>
94 </ol>
95 </div>
96 </article>
97
98 <article id="collection" title="Data Collection">
99 <h1>Data Collection</h1>
100
101 <div class="simplebox">
102 <ul>
103   <li>passive
104     <ul>
105       <li>updates, blocklists, …</li>
106     </ul>
107   </li>
108   <li>active
109     <ul>
110       <li>Telemetry, FHR, …</li>
111       <li>Crash Reports, SSL Error reports, …</li>
112     </ul>
113   </li>
114 </ul>
115 </div>
116 </article>
117
118 <article id="crashes" title="Crash Analysis">
119 <h1>Crash Analysis</h1>
120
121 <div class="simplebox">
122 <p>Finding new and rising crashes</p>
123 <p>Analyze crash data to help developers to debug and fix crash issues</p>
124 <p>Only voluntarily submitted crashes</p>
125 </div>
126 </article>
127
128 <article id="telemetry" title="Telemetry">
129 <h1>Telemetry</h1>
130
131 <div class="simplebox">
132 <p>Anonymized data from very specific probes, e.g. startup time, crashes experienced, number of bookmarks, etc.</p>
133 <p>Environment, e.g. OS, graphics hardware and drivers, add-ons, etc.</p>
134 <p>2 sets of data: base (formerly FHR) + extended</p>
135 <p><a href="https://telemetry.mozilla.org/">Dashboards &amp; Documentation</a>: telemetry.mozilla.org</p>
136 <p>Personal data in about:telemetry</p>
137 </div>
138 </article>
139
140 <article id="telemetry-examples" title="Telemetry: Examples">
141 <h1>Telemetry: Examples</h1>
142
143 <div class="simplebox">
144 <ul>
145   <li><a href="http://robertovitillo.com/2014/11/12/using-spark-to-recommend-add-ons-for-firefox/">Add-on recommendations</a></li>
146   <li><a href="http://robertovitillo.com/2014/11/25/clustering-firefox-hangs/">Firefox hangs</a></li>
147   <li><a href="http://robertovitillo.com/2015/02/16/add-on-hangs-a-brief-summary/">Add-on hangs</a></li>
148 </ul>
149 </div>
150 </article>
151
152 <article id="experiments" title="Telemetry Experiments">
153 <h1>Telemetry Experiments</h1>
154
155 <div class="simplebox">
156 <p>On pre-release channels, A/B test shipped to specific set/percentage of users, control plus experiment groups</p>
157 <p>Examples: e10s (right now), default search (late 2014)</p>
158 </div>
159 </article>
160
161 <article id="uitelemetry" title="UI Telemetry">
162 <h1>UI Telemetry</h1>
163
164 <div class="simplebox">
165 <p>Telemetry about usage of UI elements</p>
166 <p>Example: items in toolbar vs. menu panel vs. customize mode</p>
167 <p>Android:
168 <a href="https://people.mozilla.org/~mfinkle/uitelemetry/">dashboard</a>,
169 <a href="http://starkravingfinkle.org/blog/2014/07/firefox-for-android-collecting-and-using-telemetry/">initial findings</a>,
170 <a href="http://starkravingfinkle.org/blog/2015/10/fun-with-telemetry-url-suggestions/">url suggestions</a>
171 </p>
172 </div>
173 </article>
174
175 <article id="websites" title="Website A/B Testing">
176 <h1>Website A/B Testing</h1>
177
178 <div class="simplebox">
179 <p>On Mozilla websites, classic A/B testing is being done.</p>
180 <p>Examples: <a href="https://fundraising.mozilla.org/category/testing/">Fundraising</a>, many others</p>
181 </div>
182 </article>
183
184 <article id="studies" title="User Studies">
185 <h1>User Studies</h1>
186
187 <div class="simplebox">
188 Focused studies on volunteers
189 <ul>
190   <li>more invasive telemetry</li>
191   <li>diary studies</li>
192   <li>usertesting.com</li>
193   <li>in-person interviews</li>
194 </ul>
195 </div>
196 </article>
197
198 <article id="end" title="The End">
199
200 <div class="simplebox">
201 <h1 class="cent" style="position: relative; z-index: 3; color: #FFFFFF; font-size: 2.5em;">Questions?</h1>
202 <img src="mister_tricorder.jpg" class="sshot"
203      style="width: 100%; margin-top: -4.5em; position: relative; z-index: 1;"
204      alt="Data &amp; Mister Tricorder">
205 </div>
206 </article>
207
208 </body>
209 </html>