Jump to content

Uniqueness of a continuation – "Math for Non-Geeks"

From Wikibooks, open books for an open world

We derive conditions under which a measure on a σ-algebra is uniquely determined by the values on a generator. On our way, we will learn about Dynkin systems and their relation to σ-algebras. Finally, we will prove the uniqueness theorem for measure continuation.

Problem

[edit | edit source]

Continuation of functions on sets to measures are usually done in a way that the as many subsets of a basic set Ω enter the σ-algebra, as possible (while sustaining some nice properties). Often, one requires additional conditions, for instance when constructing a geometric volume, that cuboids in ℝn get assigned their geometric volume. In general, it is not clear whether such a measure with the desired properties even exists. If it does, we might have several σ-algebras where it can be defined on.

The general construction of a measure is as follows: we start with a small set system 𝒞, such that the function on sets restricted to it fulfills the desired properties. For example, for defining a geometric volume, we choose 𝒞 as the set system of cuboids and μ as the set function that assigns to each cuboid its geometric volume.

Using the existence of a continuation - theorem we know when a function μ:𝒞→[0,∞] can be continued to a measure on the σ-algebra σ(𝒞) generated by σ. For the proof of the continuation theorem, one possible continuation has been explicitly stated via outer measures. But can there also be other ways to continue μ to a measure on σ(𝒞)? In other words, we are interested in whether a measure μ on the σ-algebra σ(𝒞) is already uniquely determined by its values on the smaller set system 𝒞.

To make them easier to check, uniqueness statements are often re-formulated in mathematics: Suppose, μ and ν are measures on the σ-algebra σ(𝒞) generated by a set system 𝒞. Further, let μ and ν coincide on 𝒞, which means μ(A)=ν(A) for all A∈𝒞. Then uniqueness just means μ=ν on the whole σ algebra σ(𝒞).

In the following, we derive conditions for when this is the case.

The principle of good sets

[edit | edit source]

We will proceed step by step to find conditions on the generator 𝒞 and the two measures μ and ν under which uniqueness holds. For this we consider the system of "good sets"

𝒢:={A∈σ(𝒞):μ(A)=ν(A)}.

It contains all sets from σ(𝒞) on which μ and ν coincide. Uniqueness would mean that all sets in σ(𝒞) are good, i.e. 𝒢=σ(𝒞).

Actually, this is equivalent to saying that 𝒢 is a σ-algebra: Since by assumption, μ(C)=ν(C) is satisfied for all C∈𝒞, we have 𝒞⊆𝒢 holds. But 𝒞 already generates σ(𝒞), i.e. there is no smaller σ-algebra which contains 𝒞. So if 𝒢 is a σ-algebra, then 𝒢 (which was contained in σ(𝒞)) must be the entire σ-algebra σ(𝒞) (see: monotonicity and idempotence of the σ-operator).

This type of approach is often used to show that a given property is satisfied for all sets of a set system ℳ (like a σ-algebra). It is called the "principle of good sets" and it works like this:

Suppose one can only make statements about a generator of ℳ, perhaps because ℳ can only be characterized in terms of the generator. An example is the Borel σ-algebra, which is extremely large and can only be written down by means of generators and relations. Then it might be smart to proceed indirectly when showing a property of all sets in ℳ.

We define the set system 𝒢={A∈ℳ∣A has the given property} of "good sets". Then we show:

  • 𝒢 is a σ-algebra.
  • 𝒢 contains a generator 𝒞 of ℳ.

It follows that ℳ=𝒢, i.e. all sets in ℳ are "good". Hence, we gained control over the extremely tedious set ℳ by only using properties of the simple sets in 𝒞.

Theorem (The principle of good sets)

Let ℳ be a σ-algebra and let 𝒢 be the system of all sets from ℳ for which a given property holds. Assume that

  • 𝒢 is a σ-algebra.
  • 𝒢 contains a generator 𝒞 of ℳ.

Then the property holds for all sets from ℳ, i.e., we have that ℳ=𝒢.

Hint

The principle of good sets is very powerful. It can also be applied to other kinds of set systems (not only for σ-algebras). For instance, it can also be applied to the ring or σ-ring generated by a set system.

In our case, the sets of good sets 𝒢={A∈σ(𝒞):μ(A)=ν(A)} contains all the sets A∈σ(𝒞) on which the measures μ and ν coincide. The equality of the measures on the generator 𝒞 is known, so 𝒞⊆𝒢 holds. Now we are still looking for conditions so that 𝒢 becomes a σ-algebra. So we want to find conditions on the generator 𝒞 and the two measures μ,ν such that:

  • The basic set Ω is contained in 𝒢.
  • 𝒢 is complement stable.
  • 𝒢 is union stable with respect to countable unions.

Existence of an inner approximation

[edit | edit source]

Every σ-algebra contains the basic set Ω, so Ω should be in the set of good sets 𝒢. That is, it should hold that μ(Ω)=ν(Ω) for both measures μ and ν. In general, this need not be the case even if the two measures agree on 𝒞:

Example (Measure of the basic set is not uniquely determined)

Let 𝒞 be the set system of all one-element subsets of ℝ:

𝒞={{x}∣x∈ℝ}

The σ-algebra generated by this is

σ(𝒞)={A⊆ℝ:A countable or A∁ countable}

(This is proved in the article on generated σ-algebras). We define on σ(𝒞) the two measures μ=0 and ν via

ν(A):={0, if A countable∞ else.

Then μ and ν are equal on the generator, but not on all of σ(𝒞). Thus, they are not yet uniquely determined by specifying the values on 𝒞. In particular μ(ℝ)=0≠∞=ν(ℝ).

We can still generalize this example: Let Ω≠∅︀ be a set and let 𝒞={∅︀}. The σ-algebra generated by 𝒞 is σ(𝒞)={∅︀,Ω}. Let μ=0 be the zero measure on it, and for a r>0 let the measure ν be defined by ν(∅︀)=0,ν(Ω)=r. Then, we have μ(∅︀)=ν(∅︀), so μ and ν agree on 𝒞. However, μ(Ω)=0≠r=ν(Ω).

So with which conditions on the generator 𝒞 or the two measures μ,ν can we enforce μ(Ω)=ν(Ω)?

Idea and definition of an inner approximation

[edit | edit source]

We know that the measures μ and ν coincide on the sets in 𝒞. The idea is to cover the basic set with at most countably many sets from E1,E2,…∈𝒞, i.e. their union should be ⋃n=1∞En=Ω.

Example (Coverings of Ω=[0,∞))
  • The sets En=[n,n+2] are neither pairwise disjoint nor contained in each other.
  • The sets En=[n,n+1) are pairwise disjoint.
  • The sets En=[0,n) are contained in each other in ascending order.

Now we want to infer from μ(En)=ν(En) for all n∈ℕ (which holds since these sets are from 𝒞), that μ(Ω)=ν(Ω) holds as well. For this the En should be either pairwise disjoint or contained in each other in ascending order:

  • If the En are pairwise disjoint, we can use the σ-additivity of measures: μ(Ω)=μ(⨄i=1∞Ei)=∑n=1∞μ(Ei)=∑n=1∞ν(Ei)=ν(⨄i=1∞Ei)=ν(Ω)
  • If they are contained in each other in ascending order (i.e. E1⊆E2⊆…), they form a monotonic set sequence with limit ⋃i=1∞Ei=Ω. Then we can use the continuity of the measures μ and ν: μ(Ω)=μ(limn→∞En)=limn→∞μ(Ei)=limn→∞ν(Ei)=ν(limn→∞En)=ν(Ω)

If neither is the case, then we can not necessarily conclude μ(Ω)=ν(Ω) from μ(En)=ν(En) for all n. We consider the case where the En are contained in each other in ascending order and define the notion of exhaustion:

Definition (Exhaustion)

Let Ω be a set and let En⊆Ω be subsets for each n∈ℕ with En⊆En+1. If Ω=⋃n∈ℕEn, then the sequence (En)n∈ℕ is called an exhaustion of Ω.

Example (Exhaustion)

For Ω:=ℝ and 𝒞:={(𝒶,𝒷]:𝒶,𝒷∈ℝ} there exists an exhaustion (En)n⊆𝒞 with En:=(−n,n].

Since measures are continuous, if 𝒞 contains an exhaustion (En)n∈ℕ of Ω, then we have μ(Ω)=limn→∞μ(En)=limn→∞ν(En)=ν(Ω).

Intermediate result

[edit | edit source]

To conclude, w have found the following first condition on the set system 𝒞:

To ensure that the basic set is in the "set of good sets" 𝒢, that is, that μ(Ω)=ν(Ω) holds, we require that 𝒞 contains an exhaustion of Ω.

Hint

The condition is automatically satisfied if Ω∈𝒞 holds, e.g. if μ and ν are probability measures: Then one can assume a priori Ω∈𝒞.

The inner approximating sets have finite measure

[edit | edit source]

By requiring that Ω has an exhaustion by sets from 𝒞, we ensured that Ω lies in the "set of good sets" 𝒢={A∈σ(𝒞):μ(A)=ν(A)}. It remains to investigate under which conditions 𝒢 is closed under formation of differences and countable unions. For this purpose let us first examine under which operations 𝒢 is already closed with our previous assumptions:

Unions

[edit | edit source]

Let A and B be two sets from the set of good sets 𝒢. Thus, we have μ(A)=ν(A) and the same for B. Now, we take their union. Things look good if B⊆A: in this case A∪B=A , so μ(A∪B)=μ(A)=ν(A)=ν(A∪B) is definitely also in the set of good sets 𝒢. The same happens for A⊆B

A set '"`UNIQ--postMath-000000CF-QINU`"' does not change when adding the set '"`UNIQ--postMath-000000D0-QINU`"'

Similarly, the measure value of the union of A and B is uniquely determined if the two sets are disjoint: In that case, from additivity of the measures μ and ν it follows that

μ(A⊎B)=μ(A)+μ(B)=ν(A)+ν(B)=ν(A⊎B)

So the disjoint union is also uniquely measurable and lies again in 𝒢.


Union of the disjoint sets '"`UNIQ--postMath-000000D7-QINU`"' and '"`UNIQ--postMath-000000D8-QINU`"'

If we additionally exploit the σ-additivity of measures, then we even know the measure of countably infinite unions of disjoint sets. Given a sequence of pairwise disjoint sets A1,A2,⋯∈𝒢, the σ-additivity of measures μ and ν implies

μ(⨄i=1∞Ai)=∑i=1∞μ(Ai)=∑i=1∞ν(Ai)=ν(⨄i=1∞Ai).

Set differences

[edit | edit source]

Let again A and B be two sets from 𝒢, i.e. let μ(A)=ν(A), μ(B)=ν(B) hold. As in the case of the union, the difference of the two sets is again in 𝒢 if A and B are disjoint. In that case A∖B=A and we have that μ(A∖B)=μ(A)=ν(A)=ν(A∖B). (Likewise with the roles on A and B exchanged).

Cutting a disjoint set '"`UNIQ--postMath-000000EB-QINU`"' from '"`UNIQ--postMath-000000EC-QINU`"' has no effect

In the case A⊆B, the difference of A and B is equal to A∖B=∅︀. Since μ(∅︀)=0=ν(∅︀) , it lies again in 𝒢. Moreover, because of the additivity of the measure μ, we have that

μ(B)=μ((B∖A)⊎A)=μ(B∖A)+μ(A).

In the first equation, we used that A is a subset of B. The same is true for the measure ν instead of μ. Rearranging the above formula together with μ(A)=ν(A) and μ(B)=ν(B) yields

μ(B∖A)=μ(B)−μ(A)=ν(B)−ν(A)=ν(B∖A).

Cutting from '"`UNIQ--postMath-000000FC-QINU`"' an included set '"`UNIQ--postMath-000000FD-QINU`"'

This equation is dangerous! If A and B have infinite measure, we get the ill-defined expression "∞−∞", which cannot be sensibly defined:

Example (∞−∞ cannot be defined)

We consider the measure λ defined by the geometric length in ℝ. (We know that such a measure exists by the continuation theorem.) For the two sets A=ℝ and B=[0,∞), we have that A∖B=(−∞,0). So it follows λ(A∖B)=λ((−∞,0))=∞, and in this case, "∞−∞=∞".

By contrast, for the sets A=B=ℝ, we have that A∖B=∅︀. So λ(A∖B)=λ(∅︀)=0 and we get "∞−∞=0".

This shows that in general we cannot make sense of the expression ∞−∞, without further assumptions.

Differences of sets with infinite measure

[edit | edit source]

A way out of this problem is to approximate A and B by ascending sequences (An)n∈ℕ,(Bn)n∈ℕ of sets of finite measure and take a limit. For this, the sets of the set sequence should also be good sets. We can then calculate the measure of the differences An∖Bn as above, since μ(An) and μ(Bn) are both finite. But we have to be careful: For this to work, the subset relation An⊆Bn must also hold for the set sequences (An)n∈ℕ,(Bn)n∈ℕ for all n∈ℕ. So we cannot just choose the sequences (An)n∈ℕ and (Bn)n∈ℕ in an arbitrary manner. They need to grow "equally fast" and at the same time approximate A and B equally fast.

Recall: we assumed that there is an exhaustion (En)n∈ℕ of the basic set Ω with sets from the set system 𝒞, i.e., a monotonically growing set sequence in 𝒞 with limit Ω. (This was to guarantee μ(Ω)=ν(Ω).)

Then the sets An:=A∩En also form an increasing set sequence with limit

⋃n=1∞An=⋃n=1∞(A∩En)=A∩⋃n=1∞En=A∩Ω=A.

An exhaustion of '"`UNIQ--postMath-00000123-QINU`"' by the sets '"`UNIQ--postMath-00000124-QINU`"'

The same is true for the sequence Bn:=B∩En. Moreover, because B⊆A, we also have Bn=B∩En⊆A∩En=An, so the subset relation is satisfied for every member of the sequence. Because of Bn∖An=(B∩En)∖(A∩An)=(B∖A)∩En the sequence of (Bn∖An)n∈ℕ is also monotonically increasing.

Let us now use the same calculation as for the differences of sets with finite measure

μ(Bn∖An)=μ(Bn)−μ(An)=ν(Bn)−ν(An)=ν(Bn∖An)

and then turn to the limit n→∞. For this we need:

  • μ(An)=ν(An) and μ(Bn)=ν(Bn) for all n. That is, intersections C∩En of sets C∈𝒞 with the En are said to lie in 𝒢.
  • Each set of the exhaustion has finite measure, i.e., μ(En)<∞ for all n∈ℕ. Only then, because of monotonicity, we can be sure that μ(An)=μ(A∩En)≤μ(En)<∞ and μ(Bn)=μ(B∩En)≤μ(En)<∞ also holds, ´which is our goal.
Hint

Note that the "finiteness" of an exhaustion depends on the considered measure. For example, the exhaustion ((−n,n])n∈ℕ is finite with respect to μ≡0, but not with respect to the measure μ~ that assigns the value ∞ to every set except ∅︀.

If (An)n∈ℕ and (Bn)n∈ℕ satisfy these conditions, we can calculate the original difference B∖A (A⊆B):

μ(B∖A)=limn→∞μ(Bn∖An)=limn→∞(μ(Bn)−μ(An))=limn→∞(ν(Bn)−ν(An))=limn→∞ν(Bn∖An)=ν(B∖A).

Note that we were only able to swap difference and measure because the sets An,Bn had finite measure. We could do that for the sets A,B with infinite measure. For this we had to construct (An)n∈ℕ=(A∩En)n∈ℕ,(Bn)n∈ℕ=(B∩En)n∈ℕ.

Intersection of two exhaustions of the sets '"`UNIQ--postMath-00000144-QINU`"' and '"`UNIQ--postMath-00000145-QINU`"'

The following examples show that the sets En of the exhaustion indeed need to have finite measure in order to get uniqueness.

Example

We consider the set system of half-open intervals in ℝ

𝒞={(a,b]:−∞≤a≤b<∞}.

It generates a σ-algebra σ(𝒞) (the so-called Borel σ-algebra), which also contains all one-element subsets of ℝ. Now consider the two measures σ(𝒞) defined on μ and ν by

μ(A)={0, if A=∅︀,∞, else.

and

ν(A)=#(ℚ∩A)

for all A∈σ(𝒞). (μ is thus the trivial measure that takes only the values 0 and ∞, while ν counts the number of rational numbers contained in A). Because ℚ is dense in ℝ, the measures μ and ν coincide on the set system 𝒞. Furthermore, the exhaustion (En)n∈ℕ⊆𝒞,En:=(−n,n] of ℝ exists with μ(En)=∞=ν(En) for all n∈ℕ.

The two measures μ and ν are not equal on the σ-algebra generated by 𝒞: For all one-element sets {x}⊆ℝ, we have that μ({x})=∞ holds, but ν({x})=1 or =0. So the measures μ or ν are not yet uniquely determined by their values on 𝒞.

Intermediate result

[edit | edit source]

We conclude what has been found out:

  • The "set of good sets" 𝒢 is already closed under (at most countably infinitely many) disjoint unions; unions of sets which are subsets of each other; differences of disjoint sets; and differences of sets which are subsets of each other and have finite measure.
  • To ensure that the basic set is in 𝒢, that is, μ(Ω)=ν(Ω), we require that 𝒞 contains an exhaustion (En)n∈ℕ of Ω.
  • In order for differences of sets of infinite measure, which are subsets of each other, are in 𝒢, we require, that the exhaustion sets (En)n∈ℕ all have finite measure and that for all A∈𝒢 the intersections A∩En lie again in 𝒢.

Apart from these conditions and μ|𝒞=ν|𝒞, we make no requirements on μ, ν, and 𝒞.

The last condition is somewhat unsatisfactory, because it involves 𝒢 (which may include complicated sets). But we want to find conditions that refer only to the a priori given measures μ,ν and the generator 𝒞, respectively. We will still work on this and weaken the condition later.

Hint

In particular, the exhaustion requirements are directly satisfied if μ(Ω)=ν(Ω)<∞ holds This is always the case if μ and ν are probability measures. Then (Ω)n∈ℕ is a monotonically increasing sequence of sets with finite measure, which obviously converges to Ω.

Dynkin systems

[edit | edit source]

As before, let 𝒢={A∈σ(𝒞)∣μ(A)=ν(A)} be the system of good sets on which the two measures μ and ν coincide. Assuming that the conditions from the previous intermediate result are satisfied, we now know that the two measures are equal on the following sets:

  • The basic set Ω: this is guaranteed by the exhaustion (En)n∈ℕ⊆𝒞.
  • Unions of finitely or countably infinitely many pairwise disjoint sets in 𝒢: this holds because of σ-additivity and continuity of the measures μ and ν.
  • Differences of sets from 𝒢, where one is contained in the other: this is guaranteed by finiteness of the exhaustion and by the condition that intersections of sets from 𝒢 with sets of the exhaustion are again in 𝒞.

Thus, we can already characterize the set system 𝒢 of "good sets" more precisely. It contains the basic set and is closed under the operations "disjoint union" and "difference of sets contained in each other".

A set system with these properties is called a "Dynkin system".

Definition

[edit | edit source]
Relationship between different set systems.


Definition (Dynkin system)

A set system 𝒟⊆𝒫(Ω) is called a Dynkin system if it holds that:

  1. Ω∈𝒟
  2. for every two sets A,B∈𝒟 with A⊆B we also have B∖A∈𝒟.
  3. for each countably many pairwise disjoint sets A1,A2,⋯∈𝒟 we also have ⨄n∈ℕAn∈𝒟.
Hint

It follows directly from the definition that every σ-algebra is a Dynkin system. The converse is not true: A Dynkin system is not always a σ-algebra, because it lacks closure under non-disjoint countable unions.

An equivalent characterization of a Dynkin system is the following.

Theorem

A set system 𝒟⊆𝒫(Ω) is a Dynkin system if and only if:

  1. Ω∈𝒟
  2. for every countably many A∈𝒟, we also have A∁∈𝒟.
  3. for each countably many pairwise disjoint sets A1,A2,⋯∈𝒟 we also have ⨄n∈ℕAn∈𝒟.
Proof

Let 𝒟 be a Dynkin system in the sense of the definition above. Points 1. and 3. in the theorem are identical to the definition. We only need to show point 2. So let A∈𝒟 be arbitrary. We have that Ω∈𝒟 and A⊆Ω, so it follows from property 2. of the definition that also A∁=Ω∖A∈𝒟.

Conversely, let the three properties from the theorem be satisfied. We show that then 𝒟 is a Dynkin system in the sense of the definition above. Again, we only need to show point 2. So let A,B∈𝒟 be arbitrary with A⊆B. Let B∖A=B∩A∁=(B∁⊎A)∁. The union on the right-hand side is disjoint because of A⊆B. By assumptions 2. and 3. the set (B∁⊎A)∁=B∖A thus indeed lies in 𝒟.

So with the preconditions from the intermediate result of the previous section, 𝒢 is already a Dynkin system. All that is still missing for a σ algebra is closure under arbitrary countable unions.

Moreover, since the two measures μ and ν agree on the generator 𝒞, we have that 𝒞⊆𝒢 holds. So the Dynkin system generated by 𝒞 also lies in the set of good sets 𝒢, which is defined analogously to the generated σ-algebra:

Definition (Generated Dynkin system)

Let Ω be a set and 𝒞⊆𝒫(Ω) be a set system. The Dynkin system

δ(𝒞):=⋂{𝒟:𝒟 is a Dynkin system with 𝒞⊆𝒟}

is then called the Dynkin system generated by 𝒞. In other words, δ(𝒞) is the smallest Dynkin system containing 𝒞.

As with the definition of the generated σ-algebra, we need to convince ourselves that δ(𝒞) is well-defined. This can be done completely analogously to the proof we already gave for generated σ-algebras.

Theorem

The intersection in the above definition is not empty. Furthermore, the intersection of any number of Dynkin systems is again a Dynkin system.

Hint

Just as for generated σ-algebras, the following properties hold for the Dynkin system generated by a set system 𝒞:

  1. Extensivity: 𝒞⊆δ(𝒞)
  2. Minimality: δ(𝒞) is the smallest Dynkin system containing 𝒞. If 𝒞 is a Dynkin system, then δ(𝒞)=𝒞.
  3. Idempotence: δ(𝒞))=δ(𝒞).
  4. Monotonicity: 𝒞⊆ℰ⟹δ(𝒞)⊆δ(ℰ)

Examples

[edit | edit source]

Here are a few examples of Dynkin systems:

Example (σ-algebras)

It follows directly from the definition that any σ-algebra is also a Dynkin system.

However, not every Dynkin system is a σ-algebra:

Example (Subsets with even cardinality)

Let n>2 be an even number and Ω be a set with exactly n elements. The set system

𝒟:={A⊆Ω∣number of elements in A is even} is a Dynkin system:

Since |Ω|=n is even, we have that Ω∈𝒟.

If A,B∈𝒟 are even with A⊆B, then |B∖A|=|B|−|A| is even since |A|,|B| are even.

Since Ω is finite, we need only consider unions of finitely many disjoint sets for the third condition. Let A1,…,Ak∈𝒟 be pairwise disjoint sets, each containing an even number of elements. Then, because of disjointness, the union ⨄i=1kAi also contains an even number of elements and so lies in 𝒟.

However, 𝒟 is not a σ-algebra: Let x,y,z∈Ω be three distinct elements (these exist, since by assumption |Ω|=n>2). Then {x,y},{y,z}∈𝒟 holds, but their union {x,y,z} contains an odd number of elements, so it is not contained in 𝒟.

Motivation for cut-stability

[edit | edit source]

We considered conditions under which the set system 𝒢={A∈σ(𝒞)∣μ(A)=ν(A)} of "good" sets is a Dynkin system, i.e.

  • it contains the basic set,
  • it is closed under taking complements,
  • it is closed under taking (countable) disjoint unions.

Since we assume that the measures μ and ν coincide on the generator 𝒞, 𝒞⊆𝒢 holds. Since 𝒢 is itself a Dynkin system, therefore the Dynkin system δ(𝒞) generated by 𝒞 is also contained in 𝒢.

We would like to have σ(𝒞)⊆𝒢 , such that μ and ν agree on their whole domain of definition. So 𝒢 should not just a Dynkin system, but a σ-algebra. So what about closedness under non-disjoint finite/countably infinite unions? Let us first look at finite unions. Let A,B∈𝒢 be good sets (i.e., μ(A)=ν(A) and μ(B)=ν(B)), non-disjoint, and neither A⊆B nor B⊆A.

Union of two sets that overlap

Initially, we have μ(A)=ν(A) and μ(B)=ν(B), but it is not yet clear whether also μ(A∪B)=ν(A∪B) . Actually every value may appear on the lift-hand side, as long as we do not violate the monotonicity of μ, i.e. as long as μ(A∪B)≥μ(A) and μ(A∪B)≥μ(B).

What other conditions must be satisfied for μ(A∪B)=ν(A∪B) to hold? It suffices if the intersection A∩B is again a good set, i.e. μ(A∩B)=ν(A∩B): If A and B both have finite measure, then we have

μ(A∪B)=μ(A)+μ(B)−μ(A∩B)=ν(A)+ν(B)−ν(A∩B)=ν(A∪B).

If either set has infinite measure, the equality μ(A∪B)=∞=ν(A∪B) holds anyway. Intersections of good sets should therefore be good sets again.

A set system, which is not left, when taking arbitrary intersections between its sets is called "cut-stable":

Definition (Cut stability of a set system)

A set system ℳ is called cut stable, if

A,B∈ℳ⟹A∩B∈ℳ

Hint

By induction, the set system is then closed under intersection of any finite number of sets (not only 2), See below.

Is the cut-stability of the system of good sets 𝒢 in addition to our previous conditions already enough for it to be an σ-algebra? Suppose 𝒢 is cut-stable. The previous reasoning for two sets can be extended by induction to any finite union of good sets: Let A1,A2,…,An∈σ(𝒞) be good sets, i.e., μ(Ai)=ν(Ai) for all i=1,…,n. We also assume again that all Ai have finite measure (otherwise the equality holds anyway). Then

μ(⋃i=1nAi)=μ(An∪⋃i=1n−1Ai)=μ(An)+μ(⋃i=1n−1Ai)−μ(An∩⋃i=1n−1Ai)=i.a.ν(An)+ν(⋃i=1n−1Ai)−μ(⋃i=1n−1(An∩Ai)⏟∈𝒢)=i.a.ν(An)+ν(⋃i=1n−1Ai)−ν(⋃i=1n−1(An∩Ai))=ν(⋃i=1nAi).

(with "i.a." meaning "induction assumption") Making use of the cut-stability, we have that 𝒢 is closed under arbitrary finite unions.

Countably infinite unions ⋃n∈ℕAn can be made "artificially" disjoint by cutting the preceding ones out of each set: Define

Bn:=An∖(A1∪⋯∪An−1)=An∩(A1∪⋯∪An−1)∁,

Then ⋃n∈ℕAn=⨄n∈ℕBn is a disjoint union of sets. If the An are from 𝒢, then so are the Bn, provided that 𝒢 is cut-stable: According to the preceding, the finite union A1∪⋯∪An−1 lies in 𝒢, and so does the complement of this set (since 𝒢 is a Dynkin system). And by cut-stability also the intersection of it with An lies in 𝒢. Now, 𝒢 is closed under countable disjoint unions (Dynkin system), so also ⨄n∈ℕBn=⋃n∈ℕAn is a good set.

These considerations show: If the Dynkin system 𝒢 is additionally cut stable, it is also closed under arbitrary, at most countable unions, i.e., it is a sigma-algebra. We summarize this in a theorem:

Theorem

Cut stable Dynkin systems are σ-algebras.

Proof

Let 𝒟⊆𝒫(Ω) be a cut stable Dynkin system. Then Ω∈𝒟 and complement stability is given, as we have a Dynkin system. The remaining σ-algebra property is the union stability with respect to countable unions. So far, this is only given for pairwise disjoint unions. We first note that because A∖B=A∩B∁, difference stability follows from complement stability and intersection stability of 𝒟.

Now let (An)n∈ℕ be any sequence of sets in 𝒟. We define (Bn)n∈ℕ by B1=A1, Bn+1=An+1∖⋃i=1nAi for all n∈ℕ. Since Ai⊆Bi for all i∈ℕ we have that

⋃i=1nBi=⋃i=1n−1Bi∪(An∖(⋃i=1n−1Ai))=⋃i=1n−1Bi∪An.

With a simple induction argument it follows that ⋃i=1nBi=⋃i=1nAi and finally Bn+1=An+1∖(⋃i=1nBi).

In particular, it follows from the construction of the sequence (Bn)n∈ℕ that elements of this sequence are pairwise disjoint. By definition, B1=A1∈𝒟. Suppose now that B1,…,Bn∈𝒟 holds (induction assumption). Then with stability with respect to disjoint unions it follows that ⋃i=1nBi∈𝒟. With difference stability, we further have Bn+1=An+1∖(⋃i=1nBi)∈𝒟. Then, by induction, it also holds that Bi∈𝒟 for all i∈ℕ.

But since the Bi were additionally pairwise disjoint, it follows from the disjoint countable union stability that ⋃n∈ℕBn∈𝒟.

From this we finally get

⋃n∈ℕAn=⋃n∈ℕ⋃i=1nAi=⋃n∈ℕ⋃i=1nBi=⋃n∈ℕBn∈𝒟.

Intermediate result

[edit | edit source]

We conclude our so far obtained results:

  • To ensure that the basic set lies in the set of good sets 𝒢, that is μ(Ω)=ν(Ω), we require that 𝒞 contains an exhaustion (En)n∈ℕ of Ω.
  • To ensure that differences of sets of infinite measure which are subsets of each other, are again in 𝒢, we require, that the exhaustion sets (En)n∈ℕ all have finite measure and that for all A∈𝒢 cuts A∩En lie again in 𝒢.
  • With these two conditions, 𝒢 is already a Dynkin system. For it to be a σ-algebra, 𝒢 should be cut stable, that is, cuts of good sets should be good again.

Except for these conditions and μ|𝒞=ν|𝒞, we make no further requirements on μ, ν, and 𝒞.

Hint

While we had previously required in the second point that for all A∈𝒢 cuts A∩En must also be in 𝒢, this is no longer necessary because of the third condition.

Next, we will answer the question, which additional conditions on μ, ν, or 𝒞 will make 𝒢 cut-stable.

Cut-stability of the generator

[edit | edit source]

We have found conditions on the measures μ,ν and the generator 𝒞 by which the set of good sets 𝒢={A∈σ(𝒞)∣μ(A)=ν(A)} is a Dynkin system. In particular, 𝒢 thus contains the Dynkin system δ(𝒞) generated by 𝒞, since 𝒞⊆𝒢. We want σ(𝒞)⊆𝒢 to hold as well. For this it suffices to find additional conditions under which δ(𝒞) is cut-stable: Since every cut-stable Dynkin system is a σ-algebra, it then follows that σ(𝒞)=δ(𝒞)⊆𝒢⊆σ(𝒞), and we are done.

So under what conditions is the Dynkin system generated by 𝒞 cut-stable? This apparently depends only on the properties of the set system 𝒞, not on the measures μ or ν. In fact, it is sufficient if 𝒞 is cut-stable. This has to do with the fact that the cut operation is compatible with the union and complement operations of a Dynkin system, and thus the cut-stability is inherited from the generator to the generated Dynkin system. We show this in the following theorem.

Theorem

Any Dynkin system generated by a cut-stable set system 𝒞 is itself cut-stable.

Proof

For B∈δ(𝒞) we define 𝒟(B)={D∈δ(𝒞)|D∩B∈δ(𝒞)}, i.e., the set of sets in our Dynkin system that are cut-stable "with respect to B". By definition, 𝒟(B)⊆δ(𝒞) holds for any B∈δ(𝒞). Now we show two things:

  1. 𝒟(B) is a Dynkin system for every B∈δ(𝒞).
  2. 𝒞⊆𝒟(B) for all B∈δ(𝒞).

For, once we have shown these statements, it follows that 𝒟(B)⊆δ(𝒞)⊆δ(𝒟(B))=𝒟(B), so 𝒟(B)=δ(𝒞). Here we used monotonicity in the second step and idempotence of the δ operator in the third step. Now if A,B∈δ(𝒞) are arbitrary, then because of 𝒟(B)=δ(𝒞) we know in particular that A∈𝒟(B) holds, so A∩B∈δ(𝒞). This shows the desired cut-stability.

So let us now show the necessary statements.

Proof step: 𝒟(B) is a Dynkin system for all B∈δ(𝒞).

Let B∈δ(𝒞) be arbitrary. Obviously Ω∩B=B∈δ(𝒞), so Ω∈𝒟(B).

Let A∈𝒟(B) be arbitrary. Then A∩B∈δ(𝒞) holds. Furthermore, because of B∈δ(𝒞), of course B∁∈δ(𝒞). From this we conclude

A∁∩B=(A∁∪B∁)∩B=(A∩B)∁∩B=((A∩B)⊎B∁)∁.

This, as the complement of a disjoint union of two elements of δ(𝒞), is also an element of δ(𝒞) and so A∁∈𝒟(B), i.e. 𝒟(B) is complement stable.

Now let (Ak)k∈ℕ be a sequence of pairwise disjoint sets in ℬ. Then for all k∈ℕ, it holds that Ak∩B∈δ(𝒞). The sequence (Ak∩B)k∈ℕ is also a sequence of pairwise disjoint sets in δ(𝒞). From the stability of δ(𝒞) under countable disjoint unions, it follows that

(⨄k∈ℕAk)∩B=⨄k∈ℕ(Ak∩B)∈δ(𝒞).


So ⋃k∈ℕAk∈𝒟(B). Thus, the three properties of a Dynkin system are satisfied and we are done.

Proof step: 𝒞⊆𝒟(B) for all B∈δ(𝒞).

Let B∈δ(𝒞) and E∈𝒞 be arbitrary. Then for all D∈𝒞, due to the cut-stability of 𝒞, it holds that E∩D∈𝒞⊆δ(𝒞). So, in particular, D∈𝒟(E). Since D∈𝒞 was arbitrary, we also have 𝒞⊆𝒟(E). As 𝒟(E) is a Dynkin system (as shown before), we get δ(𝒞)⊆δ(𝒟(E))=𝒟(E). Further, B∈δ(𝒞)⊆𝒟(E) holds. That is, B∩E∈δ(𝒞) and so E∈𝒟(B). Since E∈𝒞 was chosen arbitrary, it finally follows that 𝒞⊆𝒟(B).

Since every average-stable Dynkin system is a σ algebra, it follows directly:

Theorem

If 𝒞 is a cut-stable set system, then δ(𝒞)=σ(𝒞) holds.

This relation between Dynkin systems and σ-algebras is very useful and simplifies many proofs about measures. This is because for Dynkin systems one can exploit the σ-additivity of the measure, since only disjoint unions need to be considered. In the proof of the uniqueness theorem we will see in a moment a first example where this enables to perform a proof.

Intermediate result

[edit | edit source]

We summarize the conditions we found to get σ(𝒞)=𝒢, that is, equality of μ and ν on all of σ(𝒞):

  • To ensure that the basic set is in the set of good sets 𝒢, that is, μ(Ω)=ν(Ω), we require that 𝒞 contains an exhaustion (En)n∈ℕ of Ω.
  • To ensure that differences of sets of infinite measure, which are subsets of each other, are again in 𝒢, we require that the exhaustion sets (En)n∈ℕ all have finite measure.
  • To ensure that the Dynkin system δ(𝒞) generated by 𝒞 is cut-stable, i.e., it is a σ-algebra, we require that the generator 𝒞 must be cut-stable.

In general, one cannot drop the cut-stability of 𝒞 if the measures μ and ν shall also agree on σ(𝒞), as the following example shows.

Example

Consider the (rather small as it is finite) basic set Ω={1,2,3,4} and the set system 𝒞={∅︀,{1,2},{2,3},Ω}. Then 𝒞 is not cut-stable, because {2}={1,2}∩{2,3}∉𝒞. Consider the two (probability) measures

μ:=12(δ1+δ2),ν:=12(δ2+δ4).

Here δx denotes the Dirac measure, which is defined by.

δx(A):={1, if x∈A,0 else.


Then μ and ν agree on 𝒞. Moreover, because of Ω∈𝒞, there is a finite exhaustion of the basic set. Nevertheless, μ and ν are not equal on the σ-algebra generated by 𝒞 : This σ-algebra contains the set {1,2,3}={1,2}∪{2,3}, and we have μ({1,2,3})=2≠1=ν({1,2,3}).

Uniqueness of measure continuations

[edit | edit source]

We can now formulate and prove the uniqueness theorem.

Theorem (Uniqueness of measure continuations)

Let μ and ν be two measures on the σ-algebra 𝒜 over the basic set Ω. Let there be a generator 𝒞 of 𝒜 with the following properties:

  • μ and ν coincide on 𝒞, i.e. μ(C)=ν(C) for all C∈𝒞,
  • There exists in 𝒞 an exhaustion of Ω with sets of finite measure: a monotonically increasing sequence (En)n∈ℕ⊆𝒞 with limit Ω and μ(En)=ν(En)<∞,
  • 𝒞 is cut-stable, i.e. A,B∈𝒞⟹A∩B∈𝒞.

Then μ=ν holds on all of 𝒜. So in particular a measure μ is then already uniquely determined by the values on 𝒞.

Proof (Uniqueness of measure continuations)

We perform the proof with the "principle of good sets" and define the set system 𝒢={A∈𝒜∣μ(A)=ν(A)}⊆𝒜 as containing "good sets". It contains those sets from 𝒜 on which μ and ν coincide. By assumption, 𝒞⊆𝒢 holds. We still have to show that 𝒢 is a σ-algebra. It is enough to show that 𝒞 is a Dynkin system since its generator is cut-stability. Now

𝒜=σ(𝒞)=δ(𝒞)⊆δ(𝒢)=𝒢

where we have exploited in the second equality that the Dynkin system generated by a cut-stable set system is already a σ-algebra. We now establish the properties of a Dynkin system for 𝒢 in two steps: First assuming that μ,ν are finite measures (i.e. μ(A)<∞,ν(A)<∞ for all A∈𝒜), then generalizing to the infinite measure case.

Proof step: Proof for finite μ,ν

We have Ω∈𝒢: Let (En)n∈ℕ⊆𝒞 be the exhaustion of Ω from the assumption. For this exhaustion, we have equality μ(En)=ν(En) for all n∈ℕ. Then from the continuity of the two measures μ,ν we get μ(Ω)=limn→∞μ(En)=limn→∞ν(En)=ν(Ω).

𝒢 is complement stable: let A∈𝒢. Because of μ(Ω)=ν(Ω)<∞ for finite measures, we can exploit the subtractivity and obtain

μ(A∁)=μ(Ω∖A)=μ(Ω)−μ(A)=ν(Ω)−ν(A)=ν(Ω∖A)=ν(A∁).

𝒢 is also stable under disjoint unions: Let (An)n∈ℕ⊆𝒢 be a sequence of pairwise disjoint sets in 𝒢. Taking advantage of the σ-additivity of μ and ν we obtain

μ(⨄n=1∞An)=∑n=1∞μ(An)=∑n=1∞ν(An)=ν(⨄n=1∞An).

Proof step: Proof in the general case

Now, we turn to non-finite measures.

We define for n∈ℕ the dimensions μn,νn:𝒜→[0,∞] with μn(A):=μ(A∩En) and νn(A):=ν(A∩En), where En∈𝒞 are the exhaustion sets from the assumption.

Since by assumption 𝒞 is cut-stable and μ=ν holds on 𝒞, the measures μn and νn also coincide on 𝒞. Furthermore, because of μn(A)=μ(A∩En)≤μ(En)<∞ and an analogous statement for νn, the two measures μn , νn are finite. So we can apply the statement already proved for the finite case and obtain that μn=νn holds on all 𝒜 for all n∈ℕ. The limit transition n→∞ gives that also μ and ν on all 𝒜 are equal.

Hint

This theorem is a good example of the usefulness of Dynkin systems: Because of the disjointness of all unions, we could conveniently exploit the σ-additivity of the measures μ and ν in the proof.

Because of the cut-stability of 𝒞 the sequence of sets (En)n exhausting Ω need not be monotonically increasing. It is sufficient to require that there exists a sequence (An)n⊆𝒞 such that Ω=⋃n=1∞An and μ(An)=ν(An)<∞ holds: If there exists such a sequence, we can define En=⋃i=1nAi and obtain a monotonically increasing sequence with limit Ω. Moreover, these sets also satisfy μ(En)=ν(En)<∞, as we saw in the section on cut-stability: Cut-stability ensures that μ and ν coincide even on finite (possibly non-disjoint) unions.

One therefore sometimes finds the following formulation of the uniqueness theorem:

Theorem (Uniqueness theorem (alternative version))

Let μ and ν be two measures on the σ-algebra 𝒜 over the basic set Ω. Let there be a generator 𝒞 of 𝒜 with the following properties:

  • μ and ν coincide on 𝒞, i.e. μ(C)=ν(C) for all C∈𝒞,
  • There is a sequence (An)n∈ℕ⊆𝒞 with Ω=⋃n=1∞An and μ(An)=ν(An)<∞,
  • 𝒞 is cut-stable, i.e. A,B∈𝒞⟹A∩B∈𝒞.

Then μ=ν holds on all of 𝒜.

If μ and ν are probability measures, then the second condition is always automatically satisfied: Because of μ(Ω)=ν(Ω)=1<∞ one can assume without restriction Ω∈𝒞 and choose the constant sequence (Ω)n∈ℕ. In probability theory, therefore, one often finds the following version of the uniqueness theorem:

Theorem (Uniqueness theorem for probability measures)

Let μ and ν be two probability measures on the σ-algebra 𝒜 over the basic set Ω. Let there be a cut-stable generator 𝒞 of 𝒜 on which μ and ν coincide. Then μ=ν holds on all of 𝒜.