Mryntu

• There are $r$ boxes and $n$ balls.


• Each ball is placed in a box with equal probability, independently of the other balls.


• Let $X_i$ be the number of balls in box $i$,
  $1 leq i leq r$.


• Compute $mathbbEleft[X_iright], mathbbEleft[X_iX_jright]$.

I am preparing for an exam, and I have no idea how to approach this problem. Can someone push me in the right direction ?.

Since there are $r$ boxes and $n$ balls, and each ball is placed in a box with equal probability, we have:

$$ mathbbE[X_i] = fracnr $$

Now, we would like to know what is $mathbbE[X_i X_j] $.

We begin by making the following observation:

$$X_i = n - sum_jneq iX_j $$

Which gives us:

$$ X_isum_jneq iX_j = nX_i - X_i^2$$

Now, fix $i$ (we can do this because of the symmetry in the question), and thus we have:

beginalignmathbbE[X_i X_j] &= frac1rBig(mathbbE[X_i sum_jneq i X_j] + mathbbE[X_i^2]Big) \
&= frac1r mathbbE[nX_i] \
&= fracn^2r^2
endalign

For the first part, you can use linearity of expectation to compute $mathbbE[X_i]$.
Specifically, you know that for a fixed box, the probability of putting a ball in it
is $frac1r$. Let

$$
Y_k^(i) = begincases
1 &, text if ball $k$ was placed in box $i$ \
0 &, text otherwise
endcases,
$$
which satisfies $mathbbE[Y_k^(i)] = mathbbP(Y_k^(i) = 1) = frac1r.$
Then you can write

$$
X_i = sum_j=1^n Y_j^(i) Rightarrow mathbbEX_i = sum_j=1^n frac1r = fracnr.
$$

Think of placing the ball in box "$i$" as success and not placing it as a failure.

This situation can be represented using the Hypergeometric Distribution.
$$
P(X=k) = fracK choose k N- Kchoose n - kN choose n.
$$

$N$ is the population size (number of boxes $r$)

$K$ is the number of success states in the population (just $1$ because the success is defined as placing the ball in box "$i$".)

$n$ is the number of draws (the number of balls $n$).

$k$ is the number of observed successes (the number of balls in box "$i$").

The expectation of the Hypergeometric Distribution is $nfracKN$, hence the mean of your variable
$$E[X_i]=nfrac1r=fracnr$$