The Babel of Software Development: Linguistic Diversity in Open Source

Størrelse: px

Starte visningen fra side:

Download "The Babel of Software Development: Linguistic Diversity in Open Source"

Gregers Bertelsen
5 år siden
Visninger:

Oil painting by Abel Grimmer (1570 1619) The Babel of Software Development: Linguistic Diversity in Open Source Bogdan Vasilescu

1 Oil painting by Abel Grimmer ( ) The Babel of Software Development: Linguistic Diversity in Open Source Bogdan Vasilescu Alexander Serebrenik Mark van den Brand Eindhoven University @MarkvandenBrand SocInfo 2013, Kyoto, Japan

2 Warning Equations inside

3 OSS Communities Highly interactive Heterogeneous Decentralized Self-directed Knowledge-intensive

4 OSS Communities Highly interactive Decentralized Heterogeneous Self-directed Knowledge-intensive

5 OSS Communities Developers donate their knowledge for the benefit of the community Highly interactive Decentralized Heterogeneous Self-directed Knowledge-intensive

6 OSS Communities Different skill sets and skill levels (Giuri et al., 2004) Different activities (Vasilescu et al., 2013) Mix of novices and experts (Dabbish et al., 2012) Highly interactive Decentralized Heterogeneous Self-directed Knowledge-intensive

, 2013) Mix of novices and experts (Dabbish et al.

7 OSS Communities Different skill sets and skill levels (Giuri et al., 2004) Different activities (Vasilescu et al., 2013) Mix of novices and experts (Dabbish et al., 2012) Highly interactive Decentralized Heterogeneous Self-directed Knowledge-intensive

8 Knowledge of programming languages I speak I speak... I speak... I speak I speak and I speak...

9 High turnover What happens when Purple Minion leaves the community? Does knowledge of disappear? Is the community at risk? Maintain or migrate legacy code? Poopaye!

10 High turnover What happens when Purple Minion leaves the community? Does knowledge of disappear? Is the community at risk? Maintain or migrate legacy code? Intuitively healthier

11 This talk: first steps How to quantify this risk of not finding developers with knowledge of certain programming languages?

12 Idea Who else speaks in the community? Hard to assess (recall Decentralized, Self-directed) Less suitable for real-time health monitoring Hard to maintain information (recall High Turnover) What if nobody? Poopaye!

13 Idea has worked on Who else speaks in the community? Not sufficient Specialization Territoriality (Posnett et al., 2013)! (Robles et al., 2006) (Vasilescu et al., 2013) Besides, What if nobody? Poopaye!

14 Idea has worked on Who else speaks in the community? might understand Better, but similar drawbacks as Who else speaks in the community? Does not answer How hard is it in general to find replacement CoBOL developers? I have some experience with. I might understand Poopaye!

15 Idea has worked on Who else speaks in the community? might understand Mine expertise from history of contributions + Approximate what else they might understand: universal measure of intelligibility of programming languages I have some experience with. I might understand Poopaye!

16 Ingredients Linguistic diversity (natural languages) Crowdsourced knowledge stackoverflow.com

17 Linguistic diversity Greenberg (1956) probability that two random individuals do not understand each other map/? ar_a=1&ls=840007%26f%3d491%26t%3d1%26lg%3d5%26b%3d0%26bbox

18 Linguistic diversity probability that two random individuals do not understand each other I speak I speak I speak Simple model everyone speaks exactly one language languages are independent A = 1 L p 2 p = S P L = A, B,C { } P(L) = A, B,C { } A C B

Linguistic diversity probability that two random individuals do not understand each other I speak I speak I speak Related languages model everyone speaks

19 Linguistic diversity probability that two random individuals do not understand each other I speak I speak I speak Related languages model everyone speaks exactly one language languages are (partly) mutually intelligible,m L B =1 p p m mi(, m) 0 mi(, m) 1 mi(, ) =1 L = A, B,C { } P(L) = A, B,C { } A p = C B S P

Linguistic diversity probability that two random individuals do not understand each other I speak I speak I speak and Polyglot related languages model everyone speaks at least

20 Linguistic diversity probability that two random individuals do not understand each other I speak I speak I speak and Polyglot related languages model everyone speaks at least one language languages are (partly) mutually intelligible F =1 s,t P(L) p s p t s,m t mi(, m) s t { A, B, C} P( L) = { A, B, C, AB, AC, BC ABC} L =, A p s = S s AB ABC AC P B BC C

21 Risk of not finding developers that speak a programming language Greenberg (1956) Linguistic diversity F =1 s,t P(L) p s p t s,m t mi(, m) s t Our measure risk( ) =1 s P(L) p s max k s mi (k)

22 Risk of not finding developers that speak a programming language Greenberg (1956) Linguistic diversity F =1 s,t P(L) p s p t s,m t mi(, m) s t Aggregate measure Our measure One language risk( ) =1 s P(L) p s max k s mi (k)

23 Risk of not finding developers that speak a programming language Greenberg (1956) Linguistic diversity F =1 s,t P(L) p s p t s,m t mi(, m) s t If polyglot, equally probably to speak any of the languages Our measure risk( ) =1 If polyglot, the language most intelligible to matters the most s P(L) p s max k s mi (k)

24 Risk of not finding developers that speak a programming language Greenberg (1956) Linguistic diversity F =1 s,t P(L) p s p t s,m t mi(, m) s t Symmetric Our measure Asymmetric risk( ) =1 s P(L) p s max k s mi (k) Swedes have more difficulty understanding Danish than Danes understanding Swedish (Moberg et al., 2004)

25 Ingredients Linguistic diversity (natural languages) Crowdsourced knowledge stackoverflow.com

26 5,931,622 questions 2,458,712 users

27 5,931,622 questions 2,458,712 users

28 Users collect tags

29 Mutual intelligibility of programming languages Jon Skeet: C#, Java, ASP.net, XML, Alexander Serebrenik: Prolog, SQL, C++, Bogdan Vasilescu: Python, > 400,000 mi Association rule mining ( k) = conf ( τ τ ) = nboth k nleft C# Java

30 160 popular languages Are this likely to speak <column> People who speak <row>

31 160 popular languages Are this likely to speak <column> People who speak <row>

32 Assembly dev s are versatile; assembly itself is exotic Are this likely to speak <column> People who speak <row>

33 Cobol dev s are versatile but extremely scarce Are this likely to speak <column> People who speak <row>

34 Asymmetry present also in more obvious pairs Are this likely to speak <column> People who speak <row>

Case study: Emacs 1985-2012: C, Emacs Lisp,

35 Case study: Emacs : C, Emacs Lisp, C++, Java, Lisp, Python, M4, (26) How to quantify this risk of not finding developers with knowledge of certain programming languages?

36 Case study: Emacs : C, Emacs Lisp, C++, Java, Lisp, Python, M4, (26) solid black: risk measure dashed red: %community that does not speak language dotted blue: red - black (intelligible by developers speaking other languages) Unix Shell (sh) Driver: % non speakers Exotic language: few speak it, not intelligible by developers speaking other languages

37 Case study: Emacs : C, Emacs Lisp, C++, Java, Lisp, Python, M4, (26) solid black: risk measure dashed red: %community that does not speak language dotted blue: red - black (intelligible by developers speaking other languages) Emacs Lisp Driver: % non speakers Common language: most speak it

38 Case study: Emacs : C, Emacs Lisp, C++, Java, Lisp, Python, M4, (26) solid black: risk measure dashed red: %community that does not speak language dotted blue: red - black (intelligible by developers speaking other languages) Python Exotic language But intelligible by speakers of other languages

39 Case study: Emacs : C, Emacs Lisp, C++, Java, Lisp, Python, M4, (26) solid black: risk measure dashed red: %community that does not speak language dotted blue: red - black (intelligible by developers speaking other languages) C Fairly common language Also intelligible by speakers of other languages

Relaterede dokumenter

Vina Nguyen HSSP July 13, 2008

Vina Nguyen HSSP July 13, 2008 1 What does it mean if sets A, B, C are a partition of set D? 2 How do you calculate P(A B) using the formula for conditional probability? 3 What is the difference between