+ The Oktave Forum » Technical » Science and Mathematics » Probability and Statistics
|-+ Average?
Username:
Password:

Pages: [1]
Topic Tools  
Read January 07, 2009, 03:38:59 am #0
sids

Average?

When does it make sense to calculate the average value of some data and call it a representative of that data? For the purpose of this post, I'm using the following definition of the term Average (from Wikipedia):
Quote
In mathematics, an average, or central tendency of a data set refers to a measure of the "middle" or "expected" value of the data set. There are many different descriptive statistics that can be chosen as a measurement of the central tendency of the data items.

An average is a single value that is meant to typify a list of values. If all the numbers in the list are the same, then this number should be used. If the numbers are not all the same, an easy way to get a representative value from a list is to randomly pick any number from the list. However, the word 'average' is usually reserved for more sophisticated methods that are generally found to be more useful.

The most common method is the arithmetic mean. There are many other types of averages, such as median (used most often to describe house prices and incomes). The average is calculated by combining the measurements related to a set and to compute a number as being the average of the set.

Can the probability distribution indicate if averaging makes sense? And what kind of average makes sense? For example, if we have a normal distribution, arithmetic mean clearly makes sense as an average (stating the standard deviation also might make it more representative, but that is for another discussion). But if we have a polynomial distribution (like a Power Law Distribution) or an exponential distribution (like a Poisson Distribution), what, if anything, makes sense?

If this question seems too basic, please excuse me — it obviously arises from a lack of clarity in understanding the concepts. I'd really appreciate if anyone can throw any light on this. Thanks in advance.
« Last Edit: January 07, 2009, 03:43:38 am by sids »

http://www.grok.in/
"Ignorance killed the cat, curiosity was framed."
Offline  
Read January 07, 2009, 04:13:24 am #1
sri

Re: Average?

Average (mean) makes sense only with Gaussian (normal) distributions, uniform distributions and also Poisson distributions. Essentially distributions where the variance is finite.

Power Law distributions are known to have infinite variance and the mean value will not make much sense. However Power Law becomes a linear distribution in a log-log scale and taking the logarithmic mean of the data set may make sense. Similarly log-normal distributions may be represented by their logarithmic mean.

My 2 paise worth..
Offline  
Read January 07, 2009, 04:37:03 am #2
sids

Re: Average?

Thank you, sri.

Average (mean) makes sense only with Gaussian (normal) distributions, uniform distributions and also Poisson distributions. Essentially distributions where the variance is finite.

What is meant by "variance is finite"? You mentioned that variance is finite for a normal, uniform and Poisson distributions but is infinite for Power Law Distributions. What about for exponential distributions (where mean and variance are defined)? Does an average (as a measure of central tendency) make sense here? I'm sorry if I'm missing something obvious.


http://www.grok.in/
"Ignorance killed the cat, curiosity was framed."
Offline  
Read January 07, 2009, 05:34:54 am #3
sri

Re: Average?

No idea about exponential distributions.

Power Law and similar other distributions like log-normal are also known to have infinite variance. That is, there is no maximum limit on the number of points given any value. Unlike normal distributions where you can put a finite limit within which a large percentage of the points are guaranteed to exist.

If I'm not mistaken, the infinite variance of Power Laws are what gives them the "scale-free" property.
Offline  
Pages: [1]
Jump to: