Re: [Ksummit-discuss] [MAINTAINERS SUMMIT] Talking code or talking in code!

[Shuah Khan <skhan@linuxfoundation.org>]

On 6/3/19 9:51 AM, Mark Brown wrote:
> On Fri, May 31, 2019 at 09:42:52AM -0600, Shuah Khan wrote:
> 
>> Let me go over my vision for this time slot at the Maintainers Summit
>> if we choose to add it. This isn't going to be a long deep dive session
>> on the research. I asked Isabella to work with the following outline:
> 
>> - A short summary of Sentimine
>> - A short survey of 2 or 3 emails. We do the survey - I can have her
>>    share the survey format ahead of time. Based on my recollection of
>>    the survey from OSLS presentation, it asks participants to identify
>>    the tone of the email. Positive/negative/neutral.
>> - Isabella compares these results to the tool's analysis. The goal
>>    is to see how far off the tool's analysis from real developers
>>    take on these emails.
> 
> Does that need to be done at the summit or could it be done offline with
> the summit attendees (or with a list of people pulled from the active
> developers stats or something for that matter)?  But then...
> 

I like this idea. This helps us gather data from more developers than
just the Maintainer summit attendees. We can do this after the trial
run at the Maintainer summit, provided we do add the topic to the
agenda.

>> In addition, I think the tool should also look at clarity of
>> communication not just tone. To me this is the most useful part for
>> us. My motivation and goal is to explore if we can take this opportunity
>> to influence the direction of this research to look at what would be
>> useful to us as a community.
> 
> ...it does sound like a useful way of kicking off a discussion.  Perhaps
> the survey could be done in advance and then the discussion jump
> straight on to any differences in evaluation?  I do agree that clarity
> is worth looking at, especially with regard to non-native English
> speakers.
> 

Doing survey ahead of time would help us spend more time on differences
in evaluation and help identify areas for improvement in the tool and
the assumptions it is making.

If we chose to go this route, I can work with Isabella to send the
survey out a day or two in advance to gather data.

thanks,
-- Shuah