Causal structure learning (CSL) refers to the estimation of causal graphs from data. Causal versions of tools such as ROC curves play a prominent role in empirical assessment of CSL methods and performance is often compared with “random” baselines (such as the diagonal in an ROC analysis). However, such baselines do not take account of constraints arising from the graph context and hence may represent a “low bar”. In this paper, motivated by examples in systems biology, we focus on assessment of CSL methods for multivariate data where part of the graph structure is known via interventional experiments. For this setting, we put forward a new class of baselines called graph-based predictors (GBPs). In contrast to the “random” baseline, GBPs leverage the known graph structure, exploiting simple graph properties to provide improved baselines against which to compare CSL methods. We discuss GBPs in general and provide a detailed study in the context of transitively closed graphs, introducing two conceptually simple baselines for this setting, the observed in-degree predictor (OIP) and the transitivity assuming predictor (TAP). While the former is straightforward to compute, for the latter we propose several simulation strategies. Moreover, we study and compare the proposed predictors theoretically, including a result showing that the OIP outperforms in expectation the “random” baseline on a subclass of latent network models featuring positive correlation among edge probabilities. Using both simulated and real biological data, we show that the proposed GBPs outperform random baselines in practice, often substantially. Some GBPs even outperform standard CSL methods (whilst being computationally cheap in practice). Our results provide a new way to assess CSL methods for interventional data.
KeywordsCausalityCausal structure learningInterventional dataTransitively closed graphsGene regulatory networksNull modelsDeutsches Zentrum für Neurodegenerative Erkrankungen e.V. (DZNE) in der Helmholtz-Gemeinschaft (4203)publisher-imprint-nameSpringervolume-issue-count6issue-article-count2issue-toc-levels0issue-pricelist-year2023issue-copyright-holderSpringer Science+Business Media, LLC, part of Springer Natureissue-copyright-year2023article-contains-esmNoarticle-numbering-styleContentOnlyarticle-registration-date-year2023article-registration-date-month5article-registration-date-day15article-toc-levels0toc-levels0volume-typeRegularjournal-productArchiveJournalnumbering-styleContentOnlyarticle-grants-typeOpenChoicemetadata-grantOpenAccessabstract-grantOpenAccessbodypdf-grantOpenAccessbodyhtml-grantOpenAccessbibliography-grantOpenAccessesm-grantOpenAccessonline-firstfalsepdf-file-referenceBodyRef/PDF/11222_2023_Article_10257.pdfpdf-typeTypesettarget-typeOnlinePDFissue-typeRegulararticle-typeOriginalPaperjournal-subject-primaryComputer Sciencejournal-subject-secondaryArtificial Intelligencejournal-subject-secondaryStatistics and Computing/Statistics Programsjournal-subject-secondaryStatistical Theory and Methodsjournal-subject-secondaryProbability and Statistics in Computer Sciencejournal-subject-collectionComputer Scienceopen-accesstrueIntroduction
Causal structure learning (CSL) refers to the task of estimating a graph encoding causal relationships from data (Pearl 2009; Spirtes 2010). CSL is an important and challenging topic in its own right and has attracted a great deal of recent research attention in a number of fields including statistics, machine learning and philosophy (reviewed in Heinze-Deml et al. 2018). Broadly speaking, given data X (which might be observational and/or interventional), CSL methods provide a graph estimate G^(X)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\hat{G}(X)$$\end{document} (or probabilistic analogue) with edges intended to encode causal relationships. The semantics of such graphs can be complex and depend on the precise model and application domain but for the present it is important only to emphasize that such estimators use data X to infer relationships between entities and can be viewed as encoding such information as a directed graph G^\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\hat{G}$$\end{document}.
CSL methods necessarily require assumptions on the underlying causal system that may or may not hold in real applications and whose validity may be difficult to check in practice. As a result the behaviour of CSL methods under realistic conditions (noise levels, limited sample sizes etc.) may not be clear in advance. As such, in practical settings it is important to empirically assess the efficacy of CSL methods. To this end a number of studies have focused on such assessment (including, among others, Hill et al. 2016; Heinze-Deml et al. 2018; Eigenmann et al. 2020). In the empirical assessment of CSL methods, a common strategy is to compare the estimated graph G^\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\hat{G}$$\end{document} with a “ground truth" graph G∗\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^*$$\end{document} (depending on context either the true data-generating graph in a simulation, or an scientifically/experimentally-defined gold standard). Such quantitative comparisons are usually made alongside baselines, which provide a way to contextualize the performance of the estimator G^\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\hat{G}$$\end{document} on the specific problem. Random baselines, such as the diagonal in an ROC analysis, are widely used, motivated by the idea that large deviations from the random case are an indicator that the estimator is successfully identifying causal structure.
In this paper we put forward a new class of baselines for the assessment of CSL methods in the setting that (some) interventional data is available. While random baselines are a good and useful tool, they ignore structure that might be inherent in the problem, in the sense of regularities in the ground truth graph G∗\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^*$$\end{document}. In the interventional data setting, some information on G∗\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^*$$\end{document} is available at the outset. We argue that such information can constrain possible solutions such that random baselines are in a way too general for this setting and provide only a “low bar" against which to assess CSL methods. Instead, we propose to exploit the knowledge of part of the ground truth graph in combination with straightforward graph properties, to define new baselines called graph-based predictors (GBPs), that share conceptual simplicity with classical baselines but that constitute a demonstrably stronger test.
A related line of work, developing and utilizing null models for networks seeks to contextualise interesting network features with reference to default, background models, see e.g. the surveys Fosdick et al. (2018) and Gauvin et al. (2018) as well as Chapter 11 in Fornito et al. (2016) and references therein. The key idea in these approaches is to understand whether a seemingly salient feature of a network (e.g. high levels of connectivity within specific subsets of the graph leading to the thriving area of community detection, see e.g. Newman and Girvan (2004) and the survey Fortunato (2010) and the references therein) is really unusual or noteworthy. In a similar fashion, we seek to contextualise the performance of CSL methods, using certain graph properties to define suitable baselines. However, a key difference is that in the null models literature the network itself is assumed known; in contrast, in our paper and CSL in general, the network itself is (partially) inferred.
Our work is motivated by, and illustrated in the context of, interventional experiments that have become feasible in recent years in molecular biology (see, among others, Sachs et al. 2005; Kemmeren et al. 2014; Shalem et al. 2015; Dixit et al. 2016; Ursu et al. 2022). Such experiments are crucial for the inference of molecular networks, encoding causal relationships between entities such as genes or proteins, which in turn play a central role in disease and systems biology (see e.g. Phillips 2008; Parikshak et al. 2015). The inference of molecular networks from data is a long-standing problem at the intersection of statistics, machine learning and systems biology (for introductions see e.g. Ideker et al. 2001; Babu et al. 2004; Sanguinetti and Huynh-Thu 2019; Nogueira et al. 2022).
In practice the interventional experiments in biology involve perturbation of molecular nodes (for example genes) and subsequent measurement of a high-dimensional readout (such as gene expression), specific examples of these include gene knock-out /-down, /-up, /-in experiments. Such data are relevant for causal learning because the measurement of a gene expression level for a gene B after perturbation of a gene A gives information on the (total) causal effect of A on B. Hence, if available, incorporating interventional data alongside observational data in CSL methods is desirable, and this has been studied from a number of perspectives (relevant literature includes Hauser and Bühlmann 2012; Rau et al. 2013; Spencer et al. 2015; Peters et al. 2016; Magliacane et al. 2016a, b; Meinshausen et al. 2016; Magliacane and van Ommen 2017; Wang et al. 2017; Hill et al. 2019; Rothenhäusler et al. 2019; Brouillard et al. 2020).
At the same time, interventional data are widely used to obtain gold standards to assess CSL methods (see e.g. Colombo and Maathuis 2014; Meinshausen et al. 2016; Wang et al. 2017). Notably, in practice, it is usually not feasible to perform all possible perturbation experiments due to time- and cost-constraints, rather only a subset can be performed. As we discuss in detail in Sect. 2, this can be viewed as providing information on a partial observation of the ground truth graph G∗\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^*$$\end{document} and this practical scenario is the one we focus on.
A particularly interesting and relevant special case concerns transitively closed graphs. As noted above, in real-world gene perturbation experiments, one observes the total causal effect of perturbing one gene (the target A) on another gene B (usually many such genes are measured in contemporary “omics” designs, we refer to such data in the following as omics readouts or simply as omics data). An effect of A on B may be mediated by other genes intermediate in the underlying causal path. For this reason, such effects are transitive in the sense that if A has a causal edge to B (in the underlying causal graph) and B to C, then an intervention on A may change C (this corresponds to the total causal effect of A on C), resulting in an edge from A to C in a graph constructed directly from the perturbation experiments. The assumption of observing transitively closed or ancestral causal graphs has also been made in Magliacane et al. (2016a) who consider estimating transitively closed graphs and in Heinze-Deml et al. (2018) and Eigenmann et al. (2020) where CSL methods were evaluated with respect to ancestral relations of this kind.
The contributions of this paper are as follows:
New class of baselines. We propose a new class of baselines for CSL that take account of graph properties in the case that interventional data is available. The proposed baselines leverage structural properties rooted in the underlying causal graph.
Methods for transitively closed graphs. Motivated by the nature of real-world gene perturbation experiments, we focus particular attention on transitivity and related properties and put forward specific baselines that exploit constraints derived from these properties.
Theoretical results of superiority and delineation. We show for a particular baseline a superiority-statement in the context of latent-network models. Moreover, we delineate the proposed baselines from each other theoretically.
Empirical results using real gene/protein perturbation data. Using real data from large-scale gene and protein perturbation experiments we study the behaviour of the proposed methods to understand whether they can actually provide improved baselines in practice.
Taken together, our results provide a framework for constructing improved baselines for CSL and thereby to more thoroughly assess the capabilities of CSL methods, with a focus on the use of interventional data, an area of key relevance for ongoing efforts at the interface between systems biology and large-scale perturbation designs.
The remainder of the paper is organized as follows. We begin in Sect. 2 with notation and background, defining the precise set-up for which the proposed baselines are intended. In Sects. 3.1 and 3.2 we introduce two general ways to construct graph-based predictors, based respectively on in-degree information and constraints rooted in transitivity. These two classes are illustrated with specific implementations – the observed indegree predictor (OIP) and several transitivity assuming predictors (TAPs) respectively – which are specifically derived for their use as baselines in system biology experiments. For the OIP a theoretical result of superiority over random baselines is given. Moreover, in Sect. 3.2 we propose simulation strategies for the TAPs as their direct computation is infeasible. In Sect. 3.3 combinations of the OIP and the TAPs are discussed. We detail in Sect. 3.4 the theoretical differences of all introduced candidate baselines and outline potential similarities. Section 4.1 provides detailed analysis of a simulation study of the proposed GBPs. In Sect. 4.2 we then study the behaviour of the proposed GBPs using real transcriptomics and proteomics data including observational and interventional experiments, alongside application of standard CSL methods from the literature to the same data sets. We conclude with a brief discussion on open questions and possible future work in Sect. 5.
Notation and background
In this section we give some background on CSL and introduce notation and the general set-up. In particular, we detail the structure of the data X and its underlying causal graph G in the context of CSL on interventional data.
Contextualization within CSL
We focus on the setting in which interventional and observational data are included in X. For example in the case of omics data X includes rows of readouts after targeted gene perturbations (interventional) and after control experiments (observational). In practice a gold standard ground truth graph G∗\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^*$$\end{document} might be obtained by comparing interventional and observational data, either in the current set of experiments or using previous experimental data. Given measurement of a variable B after perturbation of variable A, the causal relationship (A, B) (“from” A “to” B) is inferred by comparing the empirical distribution of B under the control experiments with the corresponding distribution under intervention on A. Since omics designs usually involve measuring many variables in parallel we consider here the common case that given a perturbation is performed on A we measure all other genes, i.e. each intervention experiment corresponds to a whole row of readouts in X. We consider only single interventions (i.e. only one node A is intervened upon in a given experiment). It is important in the below detailed set-up that we have access to interventional data in which some (but not all) genes are intervened upon, which is the common case in practice.
Some clarifications regarding our set-up are as follows: (1) We do not a priori rule out cycles in directed graphs. This is because in practice an intervention on a variable A may change B and vice versa (see also below). (2) For ease of discussion we assume that the type of intervention is fixed and that causal claims relate to the specific type of intervention. This is motivated by the fact that in practice, the precise nature of an intervention is defined by the experimental protocol, hence claims and predictions are limited to changes under the specific protocol. As a concrete example, if a knock-out of a gene A changes gene B, this does not imply that a knock-down of A would change B (since the latter experiment might induce a sub-threshold change to A) and so on. (3) For ease of computation we consider self-edges to be present at every node (compare M[k,k]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M[k,k]=1$$\end{document} for all k in (2.1) further below).
Point (1) stands in contrast to some of the classical CSL literature, in particular to methods based on directed acyclic graphs (DAGs), where the assumption of acyclicity plays a crucial role (Spirtes et al. 2000; Maathuis et al. 2009; Colombo and Maathuis 2014). Cyclic models have been discussed in the literature (see e.g. Richardson 1996; Hyttinen et al. 2014; Hill et al. 2019). In the applied context of perturbation omics experiments, cyclic models are natural, because an intervention on one gene A may lead to a change in another gene B, but an intervention on B may vice versa lead to a change in A. This is essentially due to the fact that real omics data are measurements at a given time in a dynamic system (with the causal effects always forward-in-time in the underlying system).
Notation and basic definitions
Denote a directed, unweighted graph by G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} with vertex setV=v1,v2,⋯,vp\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$V=\left\{ {}v_1,v_2,\dots {},v_p\right\} $$\end{document} and edge matrixE∈E\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E\in \mathcal {E}$$\end{document} with,E:=M∈0,1p×p:M[k,k]=1,for allk.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \mathcal {E}:=\left\{ {}M\in \left\{ {}0,1\right\} ^{p\times {}p}:M[k,k]=1,\text { for all }k\right\} \,. \end{aligned}$$\end{document}As the graphs of interest encode causal relationships between entities in V where useful we refer to them as causal graphs.
A causal graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} (left) and its induced ancestral causal graph G+=(V,E+)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^+=(V,E^+)$$\end{document} (right, “new” edges are depicted in red, i.e. E+[k,ℓ]=1≠0=E[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[k,\ell ]=1\ne {}0=E[k,\ell ]$$\end{document})
Definition 2.1
Let G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} be a causal graph.
We say there exists a causal path fromvk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document}tovℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_\ell $$\end{document}inG with vk≠vℓ∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k\ne {}v_\ell \in {}V$$\end{document}, if, for some T∈N0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$T\in \mathbb {N}_0$$\end{document} there exist vertices vk=w0,w1,⋯,wT,wT+1=vℓ∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k=w_0,w_1,\dots {},w_{T},w_{T+1}=v_{\ell }\in {}V$$\end{document} such that E[wt,wt+1]=1for all0≤t≤T.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E[w_{t},w_{t+1}]=1\text { for all }0\le {}t\le {}T. \end{aligned}$$\end{document}
Call G+=(V,E+)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^+=(V,E^+)$$\end{document} the ancestral causal graph (or the causal transitive closure) of G if (∃causal path fromvktovℓ)⇔E+[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} (\exists {}\text { causal path from} v_k \text {to} v_\ell )\,\Leftrightarrow \,{}E^+[k,\ell ]=1 \end{aligned}$$\end{document} holds. Moreover, call G an underlying causal graph of G+\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^+$$\end{document}. For an example see Fig. 1.
Call Gancestral or transitively closed if G+=G\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G^+=G$$\end{document} holds.
We note that ancestral causality has been studied in the literature using a variety of models (see e.g. Zhang 2008; Magliacane et al. 2016b; Malinsky and Spirtes 2016; Mooij and Claassen 2020) and is a complex topic in its own right. The purpose of the above definition is simply to introduce the notion of a transitive closure and make the connection to indirect causation to facilitate introduction of specific, transitivity assuming baselines below.
We will use directed graphs that are random in an edge-wise Erdős-Rényi sense as defined next (such graphs are studied in Karp 1990).
Definition 2.2
Define a random directed graph (RDG) of size p, with edge probability q and denoted by RDGq(p)=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {RDG}_{q}(p)=(V,E)$$\end{document}, as a directed graph with |V|=p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|V|=p$$\end{document} nodes, where all off-diagonal entries of E are iid draws from a Bernoulli distribution with success probability q. Moreover, given a graph G~=(V~,E~)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}=(\tilde{V},\tilde{E})$$\end{document} and a subset of edges K⊂[k,ℓ]1≤k≠ℓ≤p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {K\subset {}\left\{ {}[k,\ell ]\right\} _{1\le {}k\ne {}\ell \le {}p}}$$\end{document} we construct as RDGq,K(G~)=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {RDG}_{q,K}(\tilde{G})=(V,E)$$\end{document} the partially random directed graph with underlying G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}$$\end{document} and edge probability q by drawingE[k,ℓ]∼δ(E~[k,ℓ])if[k,ℓ]∈K,B(1,q)else.,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E[k,\ell ]\sim {\left\{ \begin{array}{ll} \delta (\tilde{E}[k,\ell ]) &{} \text {if }[k,\ell ]\in {}K, \\ B(1,q) &{} \text {else}. \end{array}\right. }, \end{aligned}$$\end{document}with δ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\delta $$\end{document} denoting the Dirac delta distribution and with iid draws from the Bernoulli distribution B(1, q).
Assumption 2.3 below specifies the set-up of the CSL problem on interventional data.
Assumption 2.3
Let G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} be a causal graph with |V|=p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|V|=p$$\end{document}. Given available interventional data X1∈Rn1×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_{1}\in {}\mathbb {R}{}^{n_1\times {}p}$$\end{document} and observational data X2∈Rm1×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2\in \mathbb {R}^{m_1\times {}p}$$\end{document} as well as latent, unavailable interventional data Y1∈Rn2×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1\in \mathbb {R}^{n_2\times {}p}$$\end{document} and latent, unavailable observational data Y2∈Rm2×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2\in \mathbb {R}^{m_2\times {}p}$$\end{document}, on the nodes V with n1,n2,m1,m2∈N>0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$n_1,n_2,m_1,m_2\in \mathbb {N}_{>0}$$\end{document}. We assume there exists a set of indices/vertices I⊂1,2,⋯,p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {I}\subset {}\left\{ {}1,2,\dots {},p\right\} $$\end{document}, called the set of available interventions, such that all interventional measurements in X1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1$$\end{document} correspond to an intervention on a node vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document} with k∈I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\in \mathcal {I}$$\end{document} and all interventional measurements in Y1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1$$\end{document} correspond to an intervention on a node vℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_\ell $$\end{document} with ℓ∉I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell \notin \mathcal {I}$$\end{document}. Moreover, we assume the existence of two ground truth functionsg1:(X1,X2)↦(E[k,ℓ])[k,ℓ]∈S1,whereS1:=([k,ℓ])k∈I,ℓ∈1,⋯,p,k≠ℓ,g2:(Y1,Y2)↦(E[k,ℓ])[k,ℓ]∈S2,whereS2:=([k,ℓ])k∉I,ℓ∈1,⋯,p,k≠ℓ.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} g_1&:(X_1,X_2)\mapsto {}(E[k,\ell ])_{[k,\ell ]\in {}S_1},\\&\text { where }S_1:=([k,\ell ])_{k\in \mathcal {I},\ell \in \left\{ {}1,\dots {},p\right\} ,k\ne {}\ell },\\ g_2&:(Y_1,Y_2)\mapsto {}(E[k,\ell ])_{[k,\ell ]\in {}S_2},\\&\text { where }S_2:=([k,\ell ])_{k\notin \mathcal {I},\ell \in \left\{ {}1,\dots {},p\right\} ,k\ne {}\ell }. \end{aligned} \end{aligned}$$\end{document}Define byX:=X1X2, and,Y:=Y1Y2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} X:=\begin{pmatrix}X_1 \\ X_2\end{pmatrix}\quad \text {, and, }\quad {}Y:=\begin{pmatrix}Y_1 \\ Y_2\end{pmatrix} \end{aligned}$$\end{document}the available data and the latent data, respectively. We denote byEX:=(E[k,ℓ])[k,ℓ]∈S1=g1(X)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E_X:=(E[k,\ell ])_{[k,\ell ]\in {}S_1}=g_1(X) \end{aligned}$$\end{document}the partial observation ofGw.r.t.I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {I}$$\end{document}. Define analogouslyEY:=(E[k,ℓ])[k,ℓ]∈S2=g2(Y)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E_Y:=(E[k,\ell ])_{[k,\ell ]\in {}S_2}=g_2(Y) \end{aligned}$$\end{document}the unobserved causal relationships ofG. Note that we have after possibly reordering of the rows of E the relationshipE=EXEY,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E=\begin{pmatrix} E_X \\ E_Y \end{pmatrix}, \end{aligned}$$\end{document}by slight abuse of notation as we consider only off-diagonal entries.
Let a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of a causal graph G based on available observational and interventional data X be given. We call a predictorΘ:0,1|S1|→[0,1]|S2|,EX↦Θ(EX)∈[0,1]|S2|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \Theta :\left\{ {}0,1\right\} ^{|S_1|}&\rightarrow [0,1]^{|S_2|}\,,\\ E_X&\mapsto {}\Theta (E_X)\in [0,1]^{|S_2|}\,, \end{aligned} \end{aligned}$$\end{document}assigning to each unobserved causal relationship a probability of its existence, based solely on the partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} a graph-based predictor (GBP). Meanwhile, a predictorΦ:R(n1+m1)×p→[0,1]|S2|,X↦Φ(X)∈[0,1]|S2|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \Phi :\mathbb {R}^{(n_1+m_1)\times {}p}&\rightarrow {}[0,1]^{|S_2|}\,,\\ X&\mapsto \Phi (X)\in [0,1]^{|S_2|}\,, \end{aligned} \end{aligned}$$\end{document}assigning to each unobserved causal relationship a probability of its existence, based on the available data matrix X will be called a data-based predictor (DBP).
The foregoing assumptions essentially ensure that the graph estimand is operationally well-defined as it is assumed that there exists some oracle procedure by which the edge structure could be determined from idealized data. In the terms above, CSL methods would usually be classified as DBPs, since they use empirical data to obtain a graph estimand.
For the sake of completeness, we introduce here notation and nomenclature for the ROC curve and the AUC in terms of our set-up, as it is a widely used performance measure for predictors such as Θ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta $$\end{document} and Ψ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Psi $$\end{document} given in (2.2) and (2.3), respectively. The ROC curve has to be defined with respect to a gold standard; accordingly for Definition 2.4 we assume that the entire graph is known for the purpose of computing the ROC curve and related quantities (of course only part of the graph is available to any estimator/CSL method; specifically, EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} is unavailable).
Definition 2.4
Let EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} be a partial observation of a non-trivial causal graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} and S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_2$$\end{document} be the indices of the unobserved causal relationships. Let R∈[0,1]|S2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R\in [0,1]^{|S_2|}$$\end{document} be the output of a predictor of EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}. Let 1=c0≥c1≥⋯≥cN≥cN+1=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$1=c_0\ge {}c_1\ge {}\cdots {}\ge {}c_{N}\ge {}c_{N+1}=0$$\end{document} be the ordered, unique values of R[k,ℓ](k,ℓ)∈S2∪0,1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}R[k,\ell ]\right\} _{(k,\ell )\in {}S_2}\cup \left\{ {}0,1\right\} $$\end{document}, with N≤|S2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$N\le {}|S_2|$$\end{document}. The receiver operator characteristic (ROC) curveROC(R) is given as the linear interpolation of the points,(FPRR(ct),TPRR(ct))t=0N+1,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \left\{ {}(FPR_{R}(c_t),TPR_{R}(c_t))\right\} _{t=0}^{N+1}, \end{aligned}$$\end{document}whereFPRR(ct)=|[k,ℓ]∈S2:R[k,ℓ]>ctandE[k,ℓ]=0||[k,ℓ]∈S2:E[k,ℓ]=0|,TPRR(ct)=|[k,ℓ]∈S2:R[k,ℓ]>ctandE[k,ℓ]=1||[k,ℓ]∈S2:E[k,ℓ]=1|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&FPR_{R}(c_t)\\&\quad {} = \frac{|\left\{ {}[k,\ell ]\in {}S_2:R[k,\ell ]>c_t\text { and }E[k,\ell ]=0\right\} |}{|\left\{ [k,\ell ]\in {}S_2:E[k,\ell ]=0\right\} |},\\&TPR_{R}(c_t)\\&\quad = \frac{|\left\{ {}[k,\ell ]\in {}S_2:R[k,\ell ]>c_t\text { and }E[k,\ell ]=1\right\} |}{|\left\{ [k,\ell ]\in {}S_2:E[k,\ell ]=1\right\} |}, \end{aligned} \end{aligned}$$\end{document}for ct≠0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$c_t\ne {}0$$\end{document} and FPRR(0)=1=TPRR(0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$FPR_R(0)=1=TPR_R(0)$$\end{document}, note that both denominators are not 0 by non-triviality of G. We define the area under curve (AUC) of the ROC curve as the finite area enclosed in ROC(R), the x-axis and the line x=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}x=1\right\} $$\end{document}. Note, that by definition (FPRR(c0),TPRR(c0))=(0,0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(FPR_R(c_0),TPR_R(c_0))=(0,0)$$\end{document}, (FPRR(cN+1),TPRR(cN+1))=(1,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(FPR_R(c_{N+1}),TPR_R(c_{N+1}))=(1,1)$$\end{document} and FPRR(ct),TPRR(ct)∈[0,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$FPR_R(c_{t}), TPR_R(c_{t})\in [0,1]$$\end{document} and hence the AUC of ROC(R) is well defined.
Remark 2.5
(Hanley and McNeil 1982; Cortes and Mohri 2004) Let EY,1:=[k,ℓ]∈S2:E[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_{Y,1}:=\left\{ [k,\ell ]\in {}S_2:E[k,\ell ]=1\right\} $$\end{document} and EY,0:=[k,ℓ]∈S2:E[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_{Y,0}:=\left\{ [k,\ell ]\in {}S_2:E[k,\ell ]=0\right\} $$\end{document}, then the AUC of the ROC curve of predicted relationships R∈[0,1]|S2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R\in [0,1]^{|S_2|}$$\end{document} is given by the Wilcoxon-Mann–Whitney statisticAUC(R)=1EY,1EY,0×∑[k,ℓ]∈EY,1∑[k′,ℓ′]∈EY,0δR[k,ℓ]>R[k′,ℓ′]+12δR[k,ℓ]=R[k′,ℓ′]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&AUC(R)=\frac{1}{\left| {}E_{Y,1}\right| \left| {}E_{Y,0}\right| }\\&\quad \times \sum _{[k,\ell ]\in {}E_{Y,1}}\sum _{[k^\prime ,\ell ^\prime ]\in {}E_{Y,0}}\left( {}\delta _{R[k,\ell ]>R[k^\prime ,\ell ^\prime ]}+\frac{1}{2}\delta _{R[k,\ell ]=R[k^\prime ,\ell ^\prime ]}\right) {} \end{aligned} \end{aligned}$$\end{document}
By the above definition the random predictor given by R[k,ℓ]=0.5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R[k,\ell ]=0.5$$\end{document} for all [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document} induces a diagonal ROC curve, as it is the linear interpolation of the points (0, 0) and (1, 1), yielding an AUC of 0.5.
Construction and theory
In the following section we propose two general forms of graph-based predictors and derive special cases thereof. Moreover, we propose computation and simulation strategies and delineate the proposed GBPs from each other. R-code for the proposed GBPs is available at github.com/richterrob/GraphBasedPredictors.
Observed indegree predictor
We start in this subsection with the idea that a node-level statistic which is partially observed in EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} can carry non-trivial information about edge labels in EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}. We go on to provide a specific instance of this general approach that uses the indegree as the node level statistic, leading to the observed indegree predictor (OIP).
GBPs based on a node-level statistic
To utilize a node-level statistic to predict the unknown entries of EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}, we need it to be both estimable from the partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} and to carry information about EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}. Suppose G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} is a causal graph and that we are given a statistic γG:V→W\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _{G}:{}V\rightarrow {}W$$\end{document} mapping the nodes of G to some feature space, e.g. W=R,Z\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$W=\mathbb {R},\mathbb {Z}$$\end{document}. We desire of γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G$$\end{document} that it,
depends only on G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document};
is not constant on V; and,
given γG(V):=(γG(v1),γG(v2),⋯γG(vp))T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G(V):=(\gamma _G(v_1),\gamma _G(v_2),\dots {}\gamma _G(v_p))^T$$\end{document} there exists a predictor θ:Wp→[0,1]|S2|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \theta :{}W^{p}\rightarrow {}[0,1]^{|S_2|}\,, \end{aligned}$$\end{document} predicting the edge labels in EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} “better than random" given (1.) and (2.) are satisfied, with “better than random" meaning that the AUC as defined in Definition 2.4 for R=θ(γG(V))\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R=\theta (\gamma _G(V))$$\end{document} is strictly larger than 0.5.
Examples of such a statistic γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _{G}$$\end{document} might include
mappings to the respective in- and outdegrees;
mappings to the respective number of ancestors and/or descendants;
Let us give an example how (3.) might be satisfied for the above given node-level statistics. Consider a graph G with p nodes, featuring nodes v1,⋯,vℓ∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1,\dots {},v_\ell \in {}V$$\end{document} with no incoming and no outgoing edge and nodes vℓ+1,⋯,vp\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_{\ell +1},\dots {},v_p$$\end{document} with at least one incoming and one outgoing edge (here 1≤ℓ≤p-1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$1\le {}\ell \le {}p-1$$\end{document}). In this case for v1,⋯,vℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_{1},\dots {},v_\ell $$\end{document} the statistics mentioned above would either convey the information that there are no incoming edges or that there are no outgoing edges. Considering as an example the first case with γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G$$\end{document} assigning to each node the number of its ancestors, we can setθ(γG(V))[k,k′]=0ifγG(V)[vk′]=0,0.5else,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \theta (\gamma _G(V))[k,k^\prime ]={\left\{ \begin{array}{ll} 0 &{} \text {if }\gamma _G(V)[v_{k^\prime }]=0,\\ 0.5 &{} \text {else} \end{array}\right. }, \end{aligned}$$\end{document}to obtain a predictor performing better than random with respect to the area under the curve of R=θ(γG(V))\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$R=\theta (\gamma _G(V))$$\end{document}. We formalize a graph-based predictor based on a node-level statistic in the following definition.
Definition 3.1
Let EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} be a partial observation of a causal graph G, γG:V→W\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G:V\rightarrow {}W$$\end{document} a statistic on the nodes of G and θ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta $$\end{document} as in (3.1). Define by γX(vk):=γG~(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _{X}(v_k):=\gamma _{\tilde{G}}(v_k)$$\end{document} the partial observation ofγG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G$$\end{document}from available dataX, where G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}$$\end{document} is the graph given by setting E[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k,\ell ]=0$$\end{document} for all [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document}. Furthermore, assume there exists an estimator β:W→W\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\beta :W\rightarrow {}W$$\end{document} of γG(V)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G(V)$$\end{document} taking as an input γX(V)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _{X}(V)$$\end{document}. A graph-based predictor based on a node-level statistic is defined byΘNLSEX:=θβγX(V).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {NLS}}\left( {}E_X\right) :=\theta \left( \beta \left( \gamma _{X}(V)\right) \right) \,. \end{aligned}$$\end{document}
Assume that G,γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G,\gamma _G$$\end{document} and θ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta $$\end{document} of the above Definition 3.1 satisfy the desiderata (1.), (2.) and (3.) stated further above. Then, given that β\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\beta $$\end{document} predicts γG(V)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G(V)$$\end{document} sufficiently well it is reasonable to claim ΘNLS\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {NLS}}$$\end{document} is performing better than random with respect to the AUC. A concrete example follows in the following subsection with the OIP including a discussion under which regime the given GBP performs better than random. For the moment let us make the following remark.
Remark 3.2
The construction of the GBP ΘNLS\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {NLS}}$$\end{document} as a general construct given in (3.2) encodes the idea “The partial observation of a node-level statistic can carry information on unseen edges”. Under which conditions the ΘNLS\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {NLS}}$$\end{document} performs “better” than the random baseline depends on its actual construction (i.e. choices of γG,θ,β,I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G,\theta ,\beta ,\mathcal {I}$$\end{document}) and is subject to an underlying distribution on the sets of graphs, i.e. G∼D\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G\sim \mathcal {D}$$\end{document}.
Observed indegree predictor In the following we consider the indegree statistic by setting γG(vk)=deg-(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G(v_k)=\text {deg}^-(v_k)$$\end{document}. Consider the desiderata on γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G$$\end{document} of Sect. 3.1, then, given that (2.) is satisfied, we have by construction that γG\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _G$$\end{document} satisfies (1.) and (3.). To see this for (3.) consider any predictor θ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta $$\end{document} in (3.1) that is strictly increasing with respect to the indegree of the potential effect. It remains to assume (2.), given below as Assumption 3.3.
Assumption 3.3
Given the set-up of Assumption 2.3, deg-\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-$$\end{document} is not a constant function on the vertex set V.
Note, that Assumption 3.3 is arguably a weak assumption, especially for large p. Thus, the indegree yields the following graph-based predictor, as a special case of (3.2).
The OIP is a good candidate for a graph-based predictor under Assumption 3.3 due to the following heuristic. Assuming that the set of performed interventions I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {I}$$\end{document} was chosen independently of the edge matrix E, we have that degX-(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-_X(v_k)$$\end{document} is the sample mean of a hypergeometric distribution (population size p-1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p-1$$\end{document}, number of success states deg-(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-(v_k)$$\end{document} and number of draws |I|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|$$\end{document}, with sample size 1), yielding in (p|I|)degX-(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(\nicefrac {p}{|\mathcal {I}|})\text {deg}_X^-(v_k)$$\end{document} an unbiased estimator of deg-(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-(v_k)$$\end{document} for all 1≤k≤p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$1\le {}k\le {}p$$\end{document}. In fact, for graphs with positive correlation structure we have the following result on the expected AUC of the OIP on a subset of S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_2$$\end{document}.
Theorem 3.5
Let G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} be such that E is drawn at random with marginal probabilitiesE[k,ℓ]∼δ(1)ifk=ℓB(1,q)else,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E[k,\ell ]\sim {\left\{ \begin{array}{ll} \delta (1) &{} \text { if }k=\ell \\ B(1,q) &{} \text { else} \end{array}\right. }, \end{aligned}$$\end{document}where q∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\in (0,1)$$\end{document}, with E[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k,\ell ]$$\end{document} and E[k′,ℓ′]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k^\prime ,\ell ^\prime ]$$\end{document} drawn independently for all k,k′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime $$\end{document} and all ℓ≠ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell \ne {}\ell ^\prime $$\end{document}, and with a covariance structure given byCovE[k,ℓ],E[k′,ℓ]|(E[k~j,ℓ])j=1J=κN,J>0,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \text {Cov}\left( {}E[k,\ell ],E[k^\prime ,\ell ]\Big |(E[\tilde{k}_j,\ell ])_{j=1}^{J}\right) =\kappa _{N,J}>0\,, \end{aligned}$$\end{document}with N:=∑j=1JE[k~j,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$N:=\sum _{j=1}^JE[\tilde{k}_j,\ell ]$$\end{document}, for all ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell $$\end{document} and any pairwise distinct k,k′,k~1,⋯,k~J∈1,2,⋯,p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime ,\tilde{k}_1,\dots {},\tilde{k}_J\in \left\{ {}1,2,\dots {},p\right\} $$\end{document}, with 0≤J≤p-2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$0\le {}J\le {}p-2$$\end{document}. Let furthermore degY-\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}_Y^-$$\end{document} be not constant on V\I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$V\setminus \mathcal {I}$$\end{document}.
Then, for any realization of the unknown relationships MY∈0,1|S2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_Y\in \left\{ {}0,1\right\} ^{|S_2|}$$\end{document} we haveEEX|EY=MY[AUCIC(ΘOIP)]>0.5,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \mathbb {E}_{E_X|E_Y=M_Y}[AUC_{\mathcal {I}^C}(\Theta _\text {OIP})]>0.5\,, \end{aligned}$$\end{document}where AUCIC\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$AUC_{\mathcal {I}^C}$$\end{document} is the AUC on [k,ℓ]∈S2:ℓ∉I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}[k,\ell ]\in {}S_2:\ell \notin {}\mathcal {I}\right\} $$\end{document}.
The proof of Theorem 3.5 can be found in “Appendix 1”. Furthermore, we show that a subclass of latent network models (e.g. Hoff et al. 2002; Bollobás et al. 2007) fall in the setting of Theorem 3.5 (see Lemma 3 in “Appendix 1”).
Remark 3.6
To extend Theorem 3.5 to the AUC on all of S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_2$$\end{document} (the complete predicted EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} by ΘOIP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {OIP}}$$\end{document}) is at this point open. Considering the proof of Theorem 3.5 additional assumptions on the distributions of degY-\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}_Y^-$$\end{document} and/or additional assumptions on q and κN,J\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\kappa _{N,J}$$\end{document} seem to be needed. For more details we refer the reader to “Appendix 1”.
Notably, the outdegree on the other hand is not a suitable candidate for a graph-based predictor in the context of Assumption 2.3: Consider any unknown relationship [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document}, since EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} is formed by complete rows of E we have no observations on the outgoing edge-labels of vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document} helping us to estimate deg+(vk)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^+(v_k)$$\end{document}.
Transitivity assuming predictor
In this section we introduce a second way to construct a graph-based predictor by assuming that the graph satisfies some property relating to a non-trivial constraint(s) on its edge matrix such that EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} carries information on EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}. Moreover, a special case of such a graph-based predictor based on transitive closedness will be derived.
GBPs based on a graph property
Let the graph G in Assumption 2.3 satisfy some constraint(s) denoted by (C), such that the partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} carries information on EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document}. We then construct a graph-based predictor via the matrix of expected values of the existence of an edge given a random draw from all graphs that satisfy (C) and are consistent with EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}. Examples of (C) might include
the graph being transitively closed;
the graph being a k-reachability graph;
the nodes of the graph having an upper/lower bound on its in- and/or outdegrees.
Definition 3.7
Let E~X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{E}_X$$\end{document} be a partial observation of a causal graph G~=(V,E~)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}=(V,\tilde{E})$$\end{document}. Suppose G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}$$\end{document} satisfies constraint(s) denoted by (C). Then a graph-based predictor based on a graph property (direct version) is defined byΘd-GPE~X[k,ℓ]:=G:Gsatisfies(C,E~X)andE[k,ℓ]=1G:Gsatisfies(C,E~X),\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\Theta _{\text{ d-GP }}\left( {}\tilde{E}_X\right) [k,\ell ]\\ {}&\quad {}:=\frac{\left| \left\{ {}G:G \text{ satisfies } (C,\tilde{E}_X) \text{ and } E[k,\ell ]=1\right\} \right| }{\left| \left\{ {}G:G \text{ satisfies } (C,\tilde{E}_X)\right\} \right| }\,, \end{aligned} \end{aligned}$$\end{document}where G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} satisfying (E~X)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(\tilde{E}_X)$$\end{document} is short for E is equal to E~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{E}$$\end{document} on S1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_1$$\end{document}.
We have at once the following remark.
Remark 3.8
Let G~=(V,E~)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}=(V,\tilde{E})$$\end{document} be drawn uniformly from the set of all graphs satisfying (C), thenΘd-GP(E~X)=EEY|EX=E~X.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {d-GP}}(\tilde{E}_X)=\mathbb {E}\left[ {}E_Y\big |E_X=\tilde{E}_X\right] \,. \end{aligned}$$\end{document}
In general Θd-GP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {d-GP}}$$\end{document} can be very hard to compute or even to simulate. For a feasible example consider (C)=(G\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(C)=(G$$\end{document} is undirected (i.e. E is symmetric) and features degree sequence d∈Rp)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$d\in \mathbb {R}^p)$$\end{document} of prescribed edge degrees. In this case there exists a broad literature on how to draw (asymptotically) uniformly at random from the set G:Gsatisfies(C)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}G:G\text { satisfies }(C)\right\} $$\end{document} (see e.g. Artzy-Randrup and Stone 2005; Newman 2003; Blitzstein and Diaconis 2011; Milo et al. 2003; Greenhill 2014), allowing in the worst case for Monte Carlo rejection sampling of (3.6), and, in the best case for direct sampling via a suitable adaptation of the Maslov–Sneppen MCMC algorithm. Unfortunately, similar strategies are not known, to the best of the authors’ knowledge, for drawing uniformly at random out of the set of all transitively closed graphs, not to mention the denominator set of (3.6) with (C)=(Gis transitively closed)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(C)=(G\text { is transitively closed})$$\end{document}. However, as elaborated in the introduction, the case of transitively closed graphs is of particular interest in the context of omics readouts after gene perturbation experiments due to the fact that in conventional designs for such experiments, direct causal relationships are in general not easily distinguished from ancestral relationships. Thus, to the end of obtaining an easier to compute/simulate GBP we construct an indirect version of (3.6) described in Eq. (3.8), below.
Definition 3.9
Let E~X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{E}_X$$\end{document} be a partial observation of a causal graph G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}$$\end{document}. Let G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}$$\end{document} satisfy constraint(s) denoted by (C) and let ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document} be a surjective mapping from the space of all graphs to the space of all graphs satisfying (C). A graph-based predictor based on a graph property (indirect version) is defined byΘi-GPE~X[k,ℓ]:=G:ϕ(G)satisfies(E~X)andϕ(E)[k,ℓ]=1G:ϕ(G)satisfies(E~X),\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\Theta _{\text{ i-GP }}\left( {}\tilde{E}_X\right) [k,\ell ]\\ {}&\quad {}:=\frac{\left| \left\{ {}G:\phi (G) \text{ satisfies }\quad (\tilde{E}_X) \text{ and } \phi (E)[k,\ell ]=1\right\} \right| }{\left| \left\{ {}G:\phi (G) \text{ satisfies } (\tilde{E}_X)\right\} \right| }\,, \end{aligned} \end{aligned}$$\end{document}where ϕ(E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi (E)$$\end{document} is the edge matrix corresponding to ϕ(G)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi (G)$$\end{document}.
The special case of (3.8) considered in the remainder of this Section is(C)=(G~is transitively closed)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(C)=(\tilde{G}\text { is transitively closed})$$\end{document}for which we use ϕ(G~)=G~+\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi (\tilde{G})=\tilde{G}^+$$\end{document}. Moreover, also for the indirect version we can make a remark in the spirit of Remark 3.8.
Remark 3.10
Let G=(V,E~)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,\tilde{E})$$\end{document} be drawn uniformly from the set of all graphs and let ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document} be as in Definition 3.9 mapping into the set of all graphs satisfying (C), thenΘi-GP(E~X)=Eϕ(E)Y|ϕ(E)X=ϕ(E~)X.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {i-GP}}(\tilde{E}_X)=\mathbb {E}\left[ {}\phi (E)_Y\big |\phi (E)_X=\phi (\tilde{E})_X\right] \,. \end{aligned}$$\end{document}
Transitivity assuming predictors As an instance of a graph-based predictor arising from a graph property we consider in this section predicting EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} of ancestral causal graphs. As mentioned earlier, this is motivated by the nature of omics readouts after intervention, since in such experiments what is seen is the total causal effect of perturbing gene A on gene B—potentially via mediators—rather than a necessarily direct causal effect.
Assumption 3.11
Given the set-up of Assumption 2.3, the causal graph G is ancestral.
Following Assumption 3.11, as a special case of (3.8), we define the following graph-based predictor.
Definition 3.12
Let EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} be a partial observation of an ancestral causal graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} with S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_2$$\end{document} being the indices of the unobserved causal relationship of G. Define byX=X(V,EX):=E0∈E:E0+[k,ℓ]=E[k,ℓ]for all[k,ℓ]∈S1,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathcal {X}=\mathcal {X}(V,E_X)\\&\quad {}:=\left\{ {}E_0\in \mathcal {E}:{}E_0^+[k,\ell ]=E[k,\ell ]\text { for all }[k,\ell ]\in {}S_1\right\} , \end{aligned} \end{aligned}$$\end{document}the set of all edge matrices E0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0$$\end{document}, whose transitive closure E0+\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+_0$$\end{document} coincides with E on the index set S1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_1$$\end{document}, i.e. the set of all edge matrices that are consistent with the partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}. We defineΘTAP(EX)[k,ℓ]=E0∈X:E0+[k,ℓ]=1|X|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {TAP}}(E_X)[k,\ell ]= \frac{\left| \left\{ {}E_0\in \mathcal {X}:E_{0}^{+}[k,\ell ]=1\right\} \right| }{|\mathcal {X}|}\,, \end{aligned}$$\end{document}calling ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document} the transitivity assuming predictor (TAP).
In contrast to the OIP, for which computation is straight-forward, computing/simulating the TAP is non-trivial. Given a non-trivial scenario, i.e. S1,S2≠∅\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$S_1,S_2\ne {}\emptyset $$\end{document}, the set X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} is determined by constraints on the (p-1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(p-1)$$\end{document}-th power of E0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0$$\end{document}. Concretely, two types of constraints surface, in detail we have E0∈X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0\in \mathcal {X}$$\end{document} if and only if Eqs. (3.11) and (3.12) below are both satisfied.E0p-1[k,ℓ]=0,∀[k,ℓ]∈S1s.t.E[k,ℓ]=0,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E_{0}^{p-1}[k,\ell ]&=0\,,\,\forall \,[k,\ell ]\in {}S_1\text { s.t. }E[k,\ell ]=0\,, \end{aligned}$$\end{document}E0p-1[k,ℓ]≠0,∀[k,ℓ]∈S1s.t.E[k,ℓ]=1.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E_{0}^{p-1}[k,\ell ]&\ne {}0\,,\,\forall \,[k,\ell ]\in {}S_1\text { s.t. }E[k,\ell ]=1\,. \end{aligned}$$\end{document}A closed form for (3.10) can, to the best of the authors’ knowledge, only be given for those entries [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document} which features ΘTAP(EX)[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}(E_X)[k,\ell ]=0$$\end{document}, as they are induced by the constraint (3.11) as Lemma 3.13 below implies, the proof of which is given in “Appendix 1”.
Lemma 3.13
Given EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} a partial observation of an ancestral causal graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} and let ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document} be the TAP defined in (3.10). Then we haveΘTAP(EX)[k,ℓ]=0⇔Avk⊈Avℓ,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {TAP}}(E_X)[k,\ell ]=0\quad \Leftrightarrow \quad \mathcal {A}_{v_k}\nsubseteq {}\mathcal {A}_{v_\ell }\,, \end{aligned}$$\end{document}where Av\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_{v}$$\end{document} denotes the set of known parents of v∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v\in {}V$$\end{document} given in EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}. We call edges satisfying the right hand side of (3.13) impossible edges.
To compute ΘTAP(EX)[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}(E_X)[k,\ell ]$$\end{document} beyond impossible edges, we are left with brute-force calculation with unfavourable computational complexity such that already for p≫10\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p\gg {}10$$\end{document} calculations may be intractable. In the remainder of the chapter we propose simulation strategies of the TAP and variants thereof, which are computationally less expensive.
Rejection sampling and choice of q
TAP - Monte-Carlo Rejection Sampling
Algorithm 1, given below, simulates for q=0.5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q=0.5$$\end{document} the TAP defined in (3.10) by straightforward Monte Carlo rejection sampling, with edge probability 0 for impossible edges, cf. Lemma 3.13. In general, it sets impossible edges to zero, draws the rest of the edge matrix entries as a partial RDG with edge probability q∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\in (0,1)$$\end{document}, see Definition 2.2, and, rejects the so drawn edge matrix E0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0$$\end{document} if E0∉X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0\notin {}\mathcal {X}$$\end{document}. This procedure is repeated until a fixed number of T∈N\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$T\in \mathbb {N}$$\end{document} non-discarded graphs have been drawn. By construction the so obtained ΘTAP(T,0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{\text {TAP}}^{(T,0.5)}}$$\end{document} is a consistent estimator of ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document}.
The rationale for introducing parameter q in Algorithm 1 is as follows. Since the probability that an RDG features the complete graph as its transitive closure goes to 1 as p→∞\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p\rightarrow \infty $$\end{document} (see Karp 1990; Krivelevich and Sudakov 2013), we have to scale the parameter T with p for sufficient convergence, increasing the computational costs. Meanwhile, letting q→0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\rightarrow {}0$$\end{document} as p→∞\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p\rightarrow \infty $$\end{document} reduces the convergence time of Algorithm 1, as we will see in Fig. 12 in “Appendix 1” (in particular with regards to Algorithm 2 further below) where q is chosen with respect to the sparsity of the observed graph. The caveat of choosing q≠0.5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\ne {}0.5$$\end{document} is that Θ^TAP(T,q)⟶T→∞ΘTAP(q)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\hat{\Theta }_\text {TAP}^{(T,q)}}\overset{T\rightarrow \infty }{\longrightarrow }\scriptstyle {\Theta _{\text {TAP}}^{(q)}}$$\end{document} which in general is not equal to ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{\text {TAP}}}$$\end{document}, i.e. Θ^TAP(T,q)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\hat{\Theta }_\text {TAP}^{(T,q)}}$$\end{document} is for q≠0.5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\ne {}0.5$$\end{document} not a consistent estimator of ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document}, as shown in Lemma 3.22 in Sect. 3.4.
Biased sampling from X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} Even for q selected smaller and smaller as the size of the graph p grows, since the rejection sampler of Algorithm 1 draws an ever growing number of discarded edge matrices, the computational costs of Algorithm 1 sill grow with p→∞\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p\rightarrow \infty $$\end{document}, see Fig. 12 in “Appendix 1”. To the end of reducing computational costs of Algorithm 1 further, consider Algorithm 2 avoiding rejections all together. Additional to the exclusion of impossible edges, Algorithm 2 includes a step drawing spanning trees to ensure the inequality constraints of (3.12) are met by pasting them in the partial RDGs drawn in Step 3.A. To this end introduce the Broder Algorithm below.
(Broder 1989) Given an un-directed graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document}, i.e. a graph as introduced in Sect. 2.2 with symmetric E. Assume G to be connected. Draw a random spanning tree (RST) rooted in v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document} by simulating a random walk x1,x2,x3,⋯,xT\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x_1,x_2,x_3,\dots {},x_T$$\end{document} on G with x1=v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x_1=v_1$$\end{document} and stopping time T∈N\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$T\in \mathbb {N}$$\end{document} such that every vertex is visited at least once. Denote for each vertex vk≠v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k\ne {}v_1$$\end{document} the index tk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$t_k$$\end{document} featuring xmin({1≤ℓ≤T:xℓ=vk})-1=vtk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x_{\min (\{1\le {}\ell \le {}T:x_\ell =v_k\})-1}=v_{t_k}$$\end{document}, i.e. vtk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_{t_k}$$\end{document} is the predecessor of the first visit of the random walk to vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document}. Then, the RST is given by the set of edgesT:=[tk,k]:2≤k≤p.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \mathcal {T}:=\left\{ {}[t_k,k]:2\le {}k\le {}p\right\} . \end{aligned}$$\end{document}
In Broder (1989) it is shown that an RST of Definition 3.14 is drawn uniformly at random out of the set of all spanning trees of G rooted in v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document}. However, for a directed graph G which is not strongly connected, a random walk as in Definition 3.14 could get “stuck” (compare also Anari et al. 2020). Consider in the following a directed graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} featuring a path from v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document} to any other vertex. To the end of drawing a computationally feasible spanning tree in G rooted in v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document} we use a modified version of the RST:
Set Y:={[k,ℓ]∈1,2,⋯,p2:E[k,ℓ]=0}\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Y}:=\{[k,\ell ]\in \left\{ {}1,2,\dots {},p\right\} ^2:E[k,\ell ]=0\}$$\end{document} to be the set of all non-edges in G.
Set W=2,3,⋯,p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$W=\left\{ {}2,3,\dots {},p\right\} $$\end{document} to be the set of all non-visited vertices.
Set κ=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\kappa =0$$\end{document} and set Tmod:=∅\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}_{\text {mod}}:=\emptyset $$\end{document}.
We call the so obtained Tmod\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}_{\text {mod}}$$\end{document} a modified RST (m-RST). Note that the above construction does not vouch for Tmod\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}_{\text {mod}}$$\end{document} being drawn uniformly at random out of the set of all spanning trees rooted in v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document}. In the case that Y=∅\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Y}=\emptyset $$\end{document} however the draw of the modified RST coincides with the draw of an RST. Since, as we will show in Sect. 3.4, Algorithm 2 does not draw uniform at random from X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} even if the spanning tree was drawn uniformly at random from all spanning trees, we except this caveat for the sake of computational simplicity. In particular, we have that Θ^B-TAP(T,q)⟶T→∞B-TAP(q)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\hat{\Theta }_{\text {B-TAP}}^{(T,q)}}\overset{T\rightarrow \infty }{\longrightarrow }\scriptstyle {{\text {B-TAP}}^{(q)}}$$\end{document} which is in general not equal to ΘTAP(q)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _\textrm{TAP}^{(q)}$$\end{document}, for any q∈[0,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\in [0,1]$$\end{document}. We call the predictor B-TAP(q)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {{\text {B-TAP}}^{(q)}}$$\end{document}biased transitivity assuming predictor (B-TAP) with edge-probability q∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\in (0,1)$$\end{document}. As for Algorithm 1 with growing p we propose to choose q according to the sparsity of the observed graph for feasible run times.
Extensions
The graph-based predictors defined in (3.2), (3.6) and (3.8) are related. Furthermore, additional graph-based predictors could be constructed. In the following section we exemplify this.
First, given Assumption 3.11 the graph G has to stem from a quite restrictive subset of all graphs in order not to satisfy Assumption 3.3, as Lemma 3.15 below shows.
Lemma 3.15
Let G=(E,V)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(E,V)$$\end{document} be a transitively closed graph such that deg-(vk)=n\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-(v_k)=n$$\end{document} for all vk∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k\in {}V$$\end{document}. Then there exists m,K∈N\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$m,K\in \mathbb {N}$$\end{document} with Km=n\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Km=n$$\end{document} such that G has K strongly connected components of cardinality m that each form complete subgraphs.
The proof of Lemma 3.15 can be found in “Appendix 1”. Due to Lemma 3.15 we can motivate the OIP not only by the type of observations EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} – complete rows – but also by the heuristic of observing ancestral graphs. This leads to a combination of the TAP and the OIP given below.
Definition 3.16
Given a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of a causal graph G, let K be the set of impossible edges as given by Lemma 3.13. Define the transitivity-assuming observed indegree predictor (T-OIP) byΘT-OIP(EX)[k,ℓ]:=0if[k,ℓ]∈K,degI-(vℓ)+1|I|+1if[k,ℓ]∉Kandℓ∉I,degI-(vℓ)+1|I|else.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\Theta _{\text {T-OIP}}(E_X)[k,\ell ]\\&\quad :={\left\{ \begin{array}{ll} 0 &{} \text {if }[k,\ell ]\in {}K\,,\\ \frac{\text {deg}_\mathcal {I}^-(v_\ell )+1}{|\mathcal {I}|+1}&{} \text {if }[k,\ell ]\notin {}K\text { and }\ell \notin {}\mathcal {I}\,,\\ \frac{\text {deg}_\mathcal {I}^-(v_\ell )+1}{|\mathcal {I}|}&{} \text {else}\\ \end{array}\right. }\,. \end{aligned} \end{aligned}$$\end{document}
Note, that to define the T-OIP, the assumption of transitivity is not needed.
Second, we can extend the definition of the TAPs, from ancestral causal graphs to all possible causal graphs. This is particularly important for omics data: First, because the TAPs should be computable even if Assumption 3.11 does not hold, for example when assuming that the causal effect dies out over long causal chains. Second, because we need to be able to compute TAPs also in the case of faulty assignments in EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}, e.g. due to measurement errors. To this end we introduce the following relaxed versions.
Having introduced multiple predictors, using closely related heuristics, cf. Lemma 3.15, the question arises whether the respective ROC curves of the predictors are related or even coincide. To this end, we provide a set of counterexamples demonstrating the differences in predicted values and, when applicable, differences in induced ROC curves between the predictors. The first example shows that ΘTAP≠ΘB-TAP(0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _\textrm{TAP}\ne {}\Theta _{{\text {B-TAP}}}^{(0.5)}}$$\end{document} and in particular that the random draw from X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} described in Algorithm 2 is not uniform even if the RST are drawn uniformly at random. To compare the marginal distribution on the edges of the drawn graphs from X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} introduceθTAP(EX)[k,ℓ]=P[E0[k,ℓ]=1|E0∈X]=|E0∈X:E0[k,ℓ]=1||X|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \theta _{\text {TAP}}(E_X)[k,\ell ]&=\mathbb {P}[E_0[k,\ell ]=1|E_0\in \mathcal {X}]\\&=\frac{|\left\{ {}E_0\in \mathcal {X}:E_{0}[k,\ell ]=1\right\} |}{|\mathcal {X}|}\,, \end{aligned} \end{aligned}$$\end{document}as the marginal conditional probability of the existence of an edge when drawing E0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0$$\end{document} according to Algorithm 1 with q=0.5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q=0.5$$\end{document} conditioned on E0∈X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0\in \mathcal {X}$$\end{document}. We have at once the following Corollary to Lemma 3.13, for a proof see “Appendix 1”.
The partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of the ancestral causal graph G given in the Example (I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {I}$$\end{document} and known edges in blue, known non-edges in red) (a). The eight possible edge label configurations on [1,2],[1,3],[2,3],[3,2]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}[1,2],[1,3],[2,3],[3,2]\right\} $$\end{document} for an edge matrix E0∈X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0\in \mathcal {X}$$\end{document}, i.e. consistent with the ancestral causal relationships given in EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} (b). Possible spanning trees on Dv1∪v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {D}_{v_1}\cup \left\{ {}v_1\right\} $$\end{document} ensuring consistency with EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} (c)
Corollary 3.18
Given EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} a partial observation of an ancestral causal graph G and let θTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)$$\end{document} be given as in (3.17). Then we have for [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document} thatθTAP(EX)[k,ℓ]=0⇔Avk⊈Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \theta _{\text {TAP}}(E_X)[k,\ell ]=0\quad \Leftrightarrow \quad \mathcal {A}_{v_k}\nsubseteq {}\mathcal {A}_{v_\ell } \end{aligned}$$\end{document}holds, where Av\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_v$$\end{document} is the set of known parents of v∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v\in {}V$$\end{document} in G.
Moreover, the following Lemma shows that edges that are “not-impossible” edges between nodes without a known ancestor in common feature θTAP=12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}=\nicefrac {1}{2}$$\end{document}.
Lemma 3.19
Given EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} a partial observation of an ancestral causal graph G and let θTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}$$\end{document} be as in (3.17). Then we have for [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document} with Avk⊆Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_{v_k}\subseteq {}\mathcal {A}_{v_\ell }$$\end{document} thatθTAP(EX)[k,ℓ]=12⇔Avk\vℓ∩Avℓ=∅,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \theta _{\text {TAP}}(E_X)[k,\ell ]=\frac{1}{2}\quad \Leftrightarrow \quad \left( \mathcal {A}_{v_k}\setminus {}\left\{ {}v_\ell \right\} \right) \cap \mathcal {A}_{v_\ell }=\emptyset , \end{aligned}$$\end{document}where Av\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_v$$\end{document} is the set of known parents of v∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v\in {}V$$\end{document} in G given in EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}.
The proof is given in “Appendix 1”. Given the above we state below the counterexample for ΘTAP≠ΘB-TAP(0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _\textrm{TAP}\ne {}\Theta _{{\text {B-TAP}}}^{(0.5)}}$$\end{document}. Note that in the following, for the sake of readability, we will augment the image space of the predictors to [0,1]p×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[0,1]^{p\times {}p}$$\end{document} instead of [0,1]|S2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[0,1]^{|S_2|}$$\end{document}.
Example
Given a set of nodes V=v1,v2,v3,v4\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$V=\left\{ {}v_1,v_2,v_3,v_4\right\} $$\end{document} and a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} as depicted in Fig. 2a. Brute force calculation of all graphs in X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} yields(θTAP(EX)[k,ℓ])k,ℓ=14=12424181801224150121524012121224≠12424202001224160121624012121224=(θB-TAP(0.5)(EX)[k,ℓ])k,ℓ=14,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&(\theta _{\text{ TAP }}(E_X)[k,\ell ])_{k,\ell =1}^4=\frac{1}{24}\begin{pmatrix} 24 &{}{} 18 &{}{} 18 &{}{} 0 \\ 12 &{}{} 24 &{}{} 15 &{}{} 0 \\ 12 &{}{} 15 &{}{} 24 &{}{} 0 \\ 12 &{}{} 12 &{}{} 12 &{}{} 24 \end{pmatrix}\\ {}&\ne {}\,\frac{1}{24}\begin{pmatrix} 24 &{}{} 20 &{}{} 20 &{}{} 0 \\ 12 &{}{} 24 &{}{} 16 &{}{} 0 \\ 12 &{}{} 16 &{}{} 24 &{}{} 0 \\ 12 &{}{} 12 &{}{} 12 &{}{} 24 \end{pmatrix}=(\theta _{\text{ B-TAP }}^{(0.5)}(E_X)[k,\ell ])_{k,\ell =1}^4\,, \end{aligned} \end{aligned}$$\end{document}where θB-TAP(0.5)(EX)[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\theta _{\text {B-TAP}}^{(0.5)}(E_X)[k,\ell ]}$$\end{document} denotes the marginal probability of E0[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0[k,\ell ]=1$$\end{document} when drawing E0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0$$\end{document} according to Algorithm 2. Note that there are no impossible edges present in the subgraph on v1,v2,v3\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}v_1,v_2,v_3\right\} $$\end{document} and thus when drawing a tree from Fig. 2c we draw uniformly at random from the set of all spanning trees rooted in v1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_1$$\end{document}, cf. Sect. 3.2. Computing furthermore the predictors ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{\text {TAP}}}$$\end{document} and ΘB-TAP(0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{{\text {B-TAP}}}^{(0.5)}}$$\end{document} yieldsΘTAP(EX)=1768768768768050476862405046247680582654654768≠1768768768768051276864005126407680584656656768=ΘB-TAP(0.5)(EX).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\Theta _{\text{ TAP }}(E_X)=\frac{1}{768}\begin{pmatrix} 768 &{}{} 768 &{}{} 768 &{}{} 0 \\ 504 &{}{} 768 &{}{} 624 &{}{} 0 \\ 504 &{}{} 624 &{}{} 768 &{}{} 0 \\ 582 &{}{} 654 &{}{} 654 &{}{} 768 \end{pmatrix}\\ {}&\ne {}\,\frac{1}{768}\begin{pmatrix} 768 &{}{} 768 &{}{} 768 &{}{} 0 \\ 512 &{}{} 768 &{}{} 640 &{}{} 0 \\ 512 &{}{} 640 &{}{} 768 &{}{} 0 \\ 584 &{}{} 656 &{}{} 656 &{}{} 768 \end{pmatrix}=\Theta _{\text{ B-TAP }}^{(0.5)}(E_X)\,. \end{aligned} \end{aligned}$$\end{document}A detailed computation of the above matrices is given in “Appendix 1”, consider to this end also (b) and (c) of Fig. 2. In this example we observe:
The marginal distributions θB-TAP(0.5)(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\theta _{\text {B-TAP}}^{(0.5)}(E_X)}$$\end{document} of Algorithm 2 and the resulting prediction ΘB-TAP(0.5)(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{\text {B-TAP}}^{(0.5)}(E_X)}$$\end{document} are not equal to θTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)$$\end{document} and ΘTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}(E_X)$$\end{document}, respectively. Hence, ΘB-TAP(T,0.5)(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{\text {B-TAP}}^{(T,0.5)}(E_X)}$$\end{document} does not converge to ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document} for T→∞\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$T\rightarrow \infty $$\end{document}.
In this example, the order of matrix entries of ΘTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}(E_X)$$\end{document} is preserved by ΘB-TAP(0.5)(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{{\text {B-TAP}}}^{(0.5)}(E_X)}$$\end{document}, hence, the induced ROC curves and thus AUC scores are the same by Definition 2.4.
To the best of the authors’ knowledge a counterexample of different ROC curves for the TAP and the B-TAP is not known. As a consequence we make the following conjecture.
Conjecture 3.20
Given a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of an ancestral causal graph G. Under (possibly quite restrictive) conditions on the descendant sets Dvk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {D}_{v_k}$$\end{document} for k∈I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\in \mathcal {I}$$\end{document} we have that the ROC curves induced by ΘTAP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}$$\end{document} and ΘB-TAP(0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{{\text {B-TAP}}}^{(0.5)}}$$\end{document} coincide.
Staying with the above Example we show ΘT-OIP(EX)≠ΘTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {T-OIP}}(E_X)\ne \Theta _{\text {TAP}}(E_X)$$\end{document} and, even more, that the induced ROC curves might differ.
Analogously to Conjecture 3.20 we conjecture that T-OIP is a “coarser” predictor than the TAP in the following.
Conjecture 3.21
Given a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of an ancestral causal graph G underlying (possibly quite restrictive) conditions. We have for edges [k,ℓ],[r,s]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ],[r,s]\in {}S_2$$\end{document} (possibly underlying some condition) that(ΘT-OIP(EX)[k,ℓ]>ΘT-OIP(EX)[r,s])⇒(ΘTAP(EX)[k,ℓ]>ΘTAP(EX)[r,s]).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&(\Theta _{\text {T-OIP}}(E_X)[k,\ell ]>\Theta _{\text {T-OIP}}(E_X)[r,s])\\&\quad {}\Rightarrow \,(\Theta _{\text {TAP}}(E_X)[k,\ell ]>\Theta _{\text {TAP}}(E_X)[r,s]). \end{aligned} \end{aligned}$$\end{document}
Last, Lemma 3.22, below, shows that changing q in Algorithm 1 may lead to potentially different ROC curves.
Lemma 3.22
There exists an ancestral causal graph G and a partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of G, as well as, q0∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q_0\in {}(0,1)$$\end{document} and edges [k,ℓ],[k′,ℓ′]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ],[k^\prime ,\ell ^\prime ]\in {}S_2$$\end{document}, such thatΘTAP(0.5)[k,ℓ]>ΘTAP(0.5)[k′,ℓ′],\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {TAP}}^{(0.5)}[k,\ell ]>\Theta _{\text {TAP}}^{(0.5)}[k^\prime ,\ell ^\prime ], \end{aligned}$$\end{document}and,ΘTAP(q0)[k,ℓ]<ΘTAP(q0)[k′,ℓ′].\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \Theta _{\text {TAP}}^{(q_0)}[k,\ell ]<\Theta _{\text {TAP}}^{(q_0)}[k^\prime ,\ell ^\prime ]. \end{aligned}$$\end{document}
The proof can be found in “Appendix 1”. Similarly we can deduce that changing q in Algorithm 2 with RST drawn uniformly at random may lead to potentially different ROC curves, leading us to conjecture that one can also find a counterexample for Algorithm 2 with RSTs drawn as m-RSTs, we refer again to “Appendix 1” for details.
Simulation study
In this section we study the use of the graph-based predictors as baselines in the case where the underlying ground truth graph satisfies Assumption 3.11 and beyond. To this end, we use simulated and real graphs.
On simulated graphs
We simulate graphs of cardinality p as transitive closures of RDGs with edge probability αp\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {\alpha }{p}$$\end{document} governed by a sparsity parameter α∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha \in {}(0,1)$$\end{document}. Note that the dependence of the sparsity on p is needed in order not to draw only graphs featuring the complete graph as their transitive closure (Krivelevich and Sudakov 2013).
Simulation study, AUC performance for varying graph size p
Simulation study, AUC performance on k-reachability graphs
In Fig. 3 box plots of the AUC performance of the ROC curves for 20 runs are presented for varying graph size p. In Fig. 3 the parameter α\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha $$\end{document} was set to 0.7 and the amount of known rows was given by |I|=p5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|=\nicefrac {p}{5}$$\end{document}. Compared are the predictors TAP (Algorithm 1, (T,q)=(100,0.5)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(T,q)=(100,0.5)$$\end{document}), TAP-q (Algorithm 1, (100,αp)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(100,\nicefrac {\alpha }{p})$$\end{document}), B-TAP (Algorithm 2, (100, 0.5)), B-TAP-q (Algorithm 2, (100,αp)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(100,\nicefrac {\alpha }{p})$$\end{document}), T-OIP and the OIP. The TAP, TAP-q, B-TAP and B-TAP-q are only computed until p=25,p=100,p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=25,p=100,p=1000$$\end{document} and p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document}, respectively, due to their exploding computational costs (see “Appendix 1”). For all p and all predictors the respective performance is on average better than random. While the variability in AUC performance decreases with growing p, the mean performance increases for all but the B-TAP and TAP. For large p the B-TAP and the TAP suffer from their slow convergence, which is especially visible when compared to the B-TAP-q and TAP-q, respectively. It stands out that the OIP, T-OIP and the B-TAP-q have a similar performance and substantially outperform the classic random baseline (at 0.5 AUC). Moreover, the OIP and the T-OIP were by a margin the fastest to compute, see for a comparison of computation times Fig. 12 in “Appendix 1”.
For the influence of α\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha $$\end{document} and |I|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|$$\end{document} on the B-TAB, B-TAB-q, OIP and T-OIP performance we refer the reader to Figs. 9 and 10 in “Appendix 1”. In summary, the order in performance of the methods remains mainly unchanged. Furthermore, for some example mean ROC curves of Fig. 3 we refer to Fig. 8 in “Appendix 1”.
In Fig. 4 we present the AUC performance of the B-TAP, B-TAP-q, OIP and T-OIP in the case the ground truth graph is a k-reachability graph and thus violates Assumption 3.11 to various extends. A graph G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} is the k-reachability graph of a graph G~=(V,E~)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{G}=(V,\tilde{E})$$\end{document} if we have(E[k,ℓ]=1)⇔(∃a path of length≤kfromvktovℓ).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&(E[k,\ell ]=1)\\&\quad \Leftrightarrow \,{}(\exists \,\text {a path of length }\le {}k \text {from}\quad v_k\quad \text {to}\quad v_\ell ). \end{aligned} \end{aligned}$$\end{document}In particular, k=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=1$$\end{document} yields G=G~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=\tilde{G}$$\end{document} and k≥p-1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\ge {}p-1$$\end{document} yields G=G~+\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=\tilde{G}^+$$\end{document}. For Fig. 4 we drew a RDG with edge probability 0.7p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {0.7}{p}$$\end{document} and graph size p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document} and computed the respective k-reachability graph. For each, the number of known rows was set to |I|=200\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|=200$$\end{document}. We observe that already for k=25\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=25$$\end{document} the AUC performance was comparable to the AUC performance on the transitively closed graph (k=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=1000$$\end{document}). Meanwhile, performance did not decrease drastically for k=2,5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=2,5$$\end{document} and prediction performance for all predictors remains better than random. One reason might be that Assumption 3.3 continues to hold even if Assumption 3.11 is violated. Additionally, drawing k-reachability graphs in this way the probabilities of existence of incoming edges at a particular node are positively correlated relating to our findings in Theorem 3.5. Note that the T-OIP looses its advantage over the OIP from incorporating the impossible edges the more Assumption 3.11 is violated. As in Fig. 3 we see that the B-TAP performs significantly worse compared to the B-TAP-q due to its slower convergence with respect to T. Last, for k=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=1$$\end{document} we see a performance of all predictors around random, which could be expected, as for randomly drawn graphs the expected indegree of each node is equal, possibly violating Assumption 3.3.
On graphs derived from “omics”-data
AUC on the yeast transcriptomics data of Kemmeren et al. (2014) performance with varying graph size, the gold-standard-threshold is fixed at Z=5\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Z=5$$\end{document}
AUC performance on the yeast transcriptomics data of Kemmeren et al. (2014) with varying gold-standard-threshold, the size of the graph is fixed at p=500\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=500$$\end{document}
Mean ROC curves on the Kemmeren et al. (2014) data for p=250\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=250$$\end{document} (a zoomed in at [0,0.02]2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[0,0.02]^2$$\end{document}) and p=500\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=500$$\end{document} (b zoomed in at [0,0.1]2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[0,0.1]^2$$\end{document}) and on the Sachs et al. (2005) data, complete (c) and zoomed in at [0,0.5]2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[0,0.5]^2$$\end{document}
In the following we test the new predictors on real yeast gene expression data1 from Kemmeren et al. (2014) (used for CSL by Meinshausen et al. 2016) and on proteomics data2 from Sachs et al. (2005) (used for CSL by Wang et al. 2017). Compared are the baselines proposed in this paper with the performance of the PC and IDA algorithms (see Spirtes et al. 2000; Maathuis et al. 2009, respectively), the MCMC-Mallow approach by Rau et al. (2013), the GIES algorithm (Hauser and Bühlmann 2012) (using the R-package pcalg Kalisch et al. 2012) and the IGSP algorithm of Wang et al. (2017).
As the backgrounds of all approaches vary let us make some remarks on their usage in this study:
For PC, GIES and IGSP the output is an estimated graph (rather than a matrix of scores) and as such only points (one for each run) on the ROC plane are depicted in Fig. 7 and comparison via the AUC is not possible.
The PC and IDA algorithms are considering any measurement as observational, as they are not designed to deal with interventional measurements. To the end of a fair comparison, we report their performance when only the available observational measurements (i.e. X2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2$$\end{document}) are passed to the algorithms (denoted by (obs)) and their performance when all available measurements (i.e. X) are passed to the respective algorithms (denoted by (int-obs)). Note, that even when interventional measurements are passed, they are treated by PC and IDA as observational.
The IGSP requires more than one interventional measurement per intervention, as this is not available for the Kemmeren et al. (2014) dataset the IGSP is only evaluated on the Sachs et al. (2005) dataset.
Default parameter choices have been used. In detail for PC (and thus IDA) we chose αPC\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha _{\text {PC}}$$\end{document} to be 0.01 as proposed in Kalisch et al. (2012), for IGSP αIGSP\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha _{\text {IGSP}}$$\end{document} has been set to 0.2 as it was among the best performing α\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha $$\end{document}‘s in the corresponding experiment in Wang et al. (2017) and the MCMC-Mallow algorithm has been used with constants set as in the accompanying R-code of Rau et al. (2013).
Transcriptomics data (Kemmeren et al.) The data consists of gene expression readouts of 262 observational experiments (i.e. with no intervention) and 1479 interventional experiments (each interventions is on a single gene, specifically knock-outs; each intervention targeting a different gene), measured are 6170 genes in total (including the 1479 intervened upon genes). We consider in this evaluation the “square" graph using only the readouts of the 1479 genes that have been intervened upon. Denote by X1∈Rp~×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1\in \mathbb {R}^{\tilde{p}\times {}p}$$\end{document} the available interventional measurements and by X2∈RN1×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2\in \mathbb {R}^{N_1\times {}p}$$\end{document} the available observational measurements, denote furthermore by Y1∈R(p-p~)×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1\in \mathbb {R}^{(p-\tilde{p})\times {}p}$$\end{document} and Y2N2×p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2^{N_2\times {}p}$$\end{document} their unavailable counterparts, cf. Assumption 2.3, and assume (if necessary via reordering) that row k and column k correspond to gene vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document}. Then the partial observation EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} is constructed by the following gold-standard-rule:(E[k,ℓ]=1)⇔X1[k,ℓ]-Med(X2[·,ℓ])>Z·IQR(X2[·,ℓ]),\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} (E[k,\ell ]=1)\Leftrightarrow \left( \left| {}X_1[k,\ell ]-\text {Med}(X_2[\cdot {},\ell ])\right| >Z\cdot {}\text {IQR}(X_2[\cdot {},\ell ])\right) , \end{aligned} \end{aligned}$$\end{document}where X1[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1[k,\ell ]$$\end{document} is the readout of gene vℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_\ell $$\end{document} after the intervention on vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document}, Med(·)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {Med}(\cdot )$$\end{document} assigns its median to a vector, Z>0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Z>0$$\end{document} is the gold-standard-threshold and IQR(·)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {IQR}(\cdot {})$$\end{document} assigns its inter-quartile-distance to a vector, i.e. there exists an edge from A to B if and only if the readout of B under intervention on A has an absolute z-score higher than Z with respect to the empirical distribution of readouts of B under no intervention. The unobserved causal relationships EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} are constructed analogously via Y1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1$$\end{document} and Y2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2$$\end{document} with the same gold-standard-threshold Z. Given a graph size p, the following protocol was used to obtain available and unavailable data:
Pick p of the 1479 genes at random and discard the rest.
Pick p~=⌈p5⌉\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{p}=\lceil {}\nicefrac {p}{5}\rceil $$\end{document} rows of the interventional readouts at random, those constitute X1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1$$\end{document}. The remaining rows constitute Y1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1$$\end{document}.
Pick N1=131\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$N_1=131$$\end{document} (half) of the rows of the observational readouts at random, those constitute X2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2$$\end{document}. The remaining rows constitute Y2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2$$\end{document}.
For Figs. 5 and 6 the above protocol was repeated 10 times, T was set to 100 for TAP, TAP-q, B-TAP and B-TAP-q, and, q of TAP-q and B-TAP-q was set to the sparsity of the partial observation provided. While in Fig. 5 the graph size p varies and Z is set to 5, in Fig. 6p is set to 500 and Z varies. Due to computational demands it was not feasible to apply all methods for all p. Figures 5 and 6 show that the proposed graph-based predictors clearly outperform the classical random baseline on the given data set. Moreover, they outperform IDA and MCMC-Mallow (where the latter ones were computed). The order of performance holds generally also for varying Z, in particular the OIP consistently outperforms IDA. Interestingly, for large Z corresponding to considering only “large” effects the differences in performance between the OIP and TAPs seem to slightly diminish, while as Z decreases only the OIP achieves a performance clearly better than random. This suggests that Assumption 3.11 may hold in practice in particular when considering larger effects.
In (a) and (b) of Fig. 7 close-ups of the mean ROC curves for p=250\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=250$$\end{document} and p=500\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=500$$\end{document} are displayed. For methods producing an estimated graph results are shown as points on the ROC plane. For both, PC and GIES, we observe a performance slightly above random which is outperformed by the OIPs and the TAPs. Moreover, on closer inspection the ascent of the OIPs and TAPs is particularly steep at the start of the ROC curves in the bottom left corner, a region often considered important when CSL methods are used for hypothesis generation (see e.g. Colombo et al. 2012; Meinshausen et al. 2016).
Proteomics data (Sachs et al.) The data consists of protein measurements of 992 observational experiments (i.e. with no interventions) and in total 13435 interventional experiments, each targeting a single protein, spread over 8 target-proteins (the number of interventional measurements per target-protein varies between 301 and 3602). In total 24 proteins are measured (among them the 8 targeted in the interventions).
As sample size for the interventional experiments is far larger compared to the data from Kemmeren et al. the two-sided Wilcoxon-ranksum test is used to construct the ground truth as done in Wang et al. (2017). In detail, given available observational measurements X2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2$$\end{document} and available interventional measurements X1,k\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_{1,k}$$\end{document} with k corresponding to the targeted intervention, i.e. X1=(X1,1T⋯X1,m~T)T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1=(X^T_{1,1}\cdots {}X^T_{1,\tilde{m}})^T$$\end{document} (for some 1≤m~≤7\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$1\le {}\tilde{m}\le {}7$$\end{document}), we say that there is an edge from protein k to protein ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell $$\end{document}, i.e. EX[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X[k,\ell ]=1$$\end{document}, if the two-sided Wilcoxon-ranksum test rejects (at significance level 0.05) the null hypothesis that the samples (X2[·,ℓ])\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(X_2[\cdot {},\ell ])$$\end{document} and (X1,k[·,ℓ])\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(X_{1,k}[\cdot {},\ell ])$$\end{document} stem from the same distribution. Via the same gold standard rule EY\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_Y$$\end{document} is constructed from Y1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1$$\end{document} and Y2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2$$\end{document}. We followed the protocol below:
Pick m~=4=82\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{m}=4=\nicefrac {8}{2}$$\end{document} interventional targets at random, all of their interventional measurements combined constitute X1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_1$$\end{document}. The remaining measurements, namely those targeting one of the other four interventional targets, constitute Y1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_1$$\end{document}.
Pick 496=9922\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$496=\nicefrac {992}{2}$$\end{document} rows of the observational measurements at random, those constitute X2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$X_2$$\end{document}. The remaining rows constitute Y2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$Y_2$$\end{document}.
In (c) and (d) of Fig. 7 the mean ROC curves over 10 runs of the protocol are compared. Again, for methods producing an estimated graph results are shown as points on the ROC plane. Even on this graph with a few number of nodes and with only |I|=4\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|=4$$\end{document} we observe a better performance than random of the GBPs, in particular the variants of the OIP and the TAP even outperform the IDA and perform comparably or slightly better than the MCMC-Mallow approach, compare also the AUC comparison in Fig. 11 in “Appendix 1”. Moreover, we see that CSL methods outputting an estimated graph in fact lie only in a minority of runs over the mean OIP ROC curve (PC (obs-int) (2-3/10), IGSP (1-2/10)), or in fact, never as is the case for PC (obs) and GIES.
Furthermore, in Fig. 12 of “Appendix 1” the computational costs of Figs. 5 and 7 are reported. In particular the OIPs have very low computation times, while the MCMC-Mallow and IGSP take considerable longer to compute.
Discussion
In this paper we have argued for new baselines to evaluate causal structure learning methods on interventional data, as a complement to random baselines that in some settings may represent a “low bar”. The inclusion of interventional measurements carries information not only on the edges of the causal graph corresponding to the available interventional measurements, but also, to some extent, on remaining edges in the graph. This is why in settings where such data are available, simple heuristics to account for the available information can provide improved baselines. For these settings we introduced three general graph-based predictors, cf. (3.2), (3.6) and (3.8). Motivated by large-scale systems biology experiments we went on to consider special cases of (3.2) and (3.8) in the observed indegree predictor (OIP) and the transitivity assuming predictor (TAP) and extensions thereof. We showed that the OIP will perform under quite general conditions better than the random baseline and we showed theoretical differences of the introduced predictors. The potential of the OIPs and TAPs as more challenging baselines were demonstrated in a simulation study as well as on real data. In fact on real data the newly defined baselines can outperform standard CSL methods (with default tuning parameter values), although it should be emphasized that in the particular application studied, the assumptions underpinning some of the methods may not hold and furthermore in some examples we had to apply the methods in ways that deviate from their intended use.
In the future new graph-based predictors could be defined for specific use-cases. Moreover, an evaluation of the baseline’s performance on further metrics, beyond the ROC, might be desirable. In its general nature, this paper focussed on ROC curves and their accompanying AUCs. As GBPs estimate only the graph structure and not underlying distributions, recently proposed evaluations of CSL methods taking in account estimated distributions of the measurements X can not be considered (O’Donnell et al. 2021). However, for particular use-cases evaluation on a more specific metric and/or forcing the GBPs to predict binary graphs - as PC, IGSP and GIES do, for example via cross-validation - might be insightful. This is in particularly true for the OIP as it performed best on the real data in Sect. 4.2.
Regarding the computation of the TAP, it remains to be seen whether for large p one can devise a feasible, consistent simulation procedure, or, if resorting to the B-TAP or a changed q remains necessary. Moreover, it would be of interest to study whether the resulting ROC curves of the TAP, B-TAP and OIP can in general be related as conjectured in Sect. 3.4.
Acknowledgements
We would like to thank Bernd Taschler of the University of Oxford for feedback and help in data processing and in testing the R code. Moreover, we thank the anonymous reviewers and the associate editor for their help in improving this contribution. This work was supported by the Bundesministerium für Bildung und Forschung (BMBF) project “MechML”. S. Bhamidi was supported in part by the National Science Foundation (NSF) grants DMS-2113662 and DMS-2134107.
Author contributions
All authors contributed to the conceptualization and methodology of the paper. R.R. conducted the formal analysis including the derivation of the proofs, wrote the software and prepared the figures. Proofs and statements of Theorem 3.4, Lemma A.1 and Lemma A.3 were derived equally by R.R. and S.B. R.R. and S.M. wrote the main manuscript text with input from S.B.. All authors reviewed the manuscript.
Funding
Open Access funding enabled and organized by Projekt DEAL.
DeclarationsConflict of interest
The authors declare that they have no conflict of interest.
ReferencesAnari, N., Hu, N., Saberi, A., Schild, A.: Sampling arborescences in parallel (2020). arXiv:2012.09502Artzy-RandrupYStoneLGenerating uniformly distributed random networksPhys. Rev. E2005725219832310.1103/PhysRevE.72.056708BabuMMLuscombeNMAravindLGersteinMTeichmannSAStructure and evolution of transcriptional regulatory networksCurr. Opin. Struct. Biol.200414328329110.1016/j.sbi.2004.05.004BlitzsteinJDiaconisPA sequential importance sampling algorithm for generating random graphs with prescribed degreesInternet Math.201164489522280983610.1080/15427951.2010.5572771238.60084BollobásBJansonSRiordanOThe phase transition in inhomogeneous random graphsRandom Struct. Algorithms20073113122233739610.1002/rsa.201681123.05083BroderAZGenerating random spanning treesFOCS198989442447BrouillardPLachapelleSLacosteALacoste-JulienSDrouinADifferentiable causal discovery from interventional dataAdv. Neural. Inf. Process. Syst.2020332186521877ColomboDMaathuisMHOrder-independent constraint-based causal structure learningJ. Mach. Learn. Res.2014153741378232914111312.68165ColomboDMaathuisMHKalischMRichardsonTSLearning high-dimensional directed acyclic graphs with latent and selection variablesAnn. Stat.2012401294321301430810.1214/11-AOS9401246.62131Cortes, C., Mohri, M.: Confidence intervals for the area under the roc curve. Adv. Neural Inf. Process. Syst. 17 (2004)DixitAParnasOLiBChenJFulcoCPJerby-ArnonLMarjanovicNDDionneDBurksTRaychowdhuryRAdamsonBNormanTMLanderESWeissmanJSFriedmanNRegevAPerturb-seq: dissecting molecular circuits with scalable single-cell RNA profiling of pooled genetic screensCell2016167718531866.e1710.1016/j.cell.2016.11.038Eigenmann, M., Mukherjee, A., Maathuis, M.: Evaluation of causal structure learning algorithms via risk estimation. In: UAI, pp. 151–160. PMLR (2020). http://proceedings.mlr.press/v124/eigenmann20a.htmlFornitoAZaleskyABullmoreEFundamentals of Brain Network Analysis2016CambridgeAcademic Press10.1016/C2012-0-06036-XFortunatoSCommunity detection in graphsPhys. Rep.20104863–575174258041410.1016/j.physrep.2009.11.002FosdickBKLarremoreDBNishimuraJUganderJConfiguring random graph models with fixed degree sequencesSIAM Rev.2018602315355379772110.1137/16M10871751387.05235Gauvin, L., Génois, M., Karsai, M., Kivelä, M., Takaguchi, T., Valdano, E., Vestergaard, C.L. Randomized reference models for temporal networks (2018). arXiv:1806.04032Greenhill, C.: The switch Markov chain for sampling irregular graphs. In: Proceedings of the Twenty-Sixth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1564–1572. SIAM (2014)HanleyJAMcNeilBJThe meaning and use of the area under a receiver operating characteristic (ROC) curveRadiology19821431293610.1148/radiology.143.1.7063747HauserABühlmannPCharacterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphsJ. Mach. Learn. Res.20121312409246429736061433.68346Heinze-DemlCMaathuisMHMeinshausenNCausal structure learningAnnu. Rev. Stat. Appl.201851371391377475210.1146/annurev-statistics-031017-100630Hill, S.M., Heiser, L.M., Cokelaer, T., Unger, M., Nesser, N.K., Carlin, D.E., Zhang, Y., Sokolov, A., Paull, E.O., Wong, C.K., Graim, K., Bivol, A., Wang, H., Zhu, F., Afsari, B., Danilova, L.V., Favorov, A.V., Lee, W.S., Taylor, D., Hu, C.W., Long, B.L., Noren, D.P., Bisberg, A.J., Consortium, H.-D., Mills, G.B., Gray, J.W., Kellen, M., Norman, T., Friend, S., Qutub, A.A., Fertig, E.J., Guan, Y., Song, M., Stuart, J.M., Spellman, P.T., Koeppl, H., Stolovitzky, G., Saez-Rodriguez, J., Mukherjee, S.: Inferring causal molecular networks: empirical assessment through a community-based effort. Nat. Methods 13(4), 310–318 (2016). https://doi.org/10.1038/nmeth.3773HillSMOatesCJBlytheDAMukherjeeSCausal learning via manifold regularizationJ. Mach. Learn. Res.: JMLR201920127400288110.17863/cam.447181434.68414HoffPDRafteryAEHandcockMSLatent space approaches to social network analysisJ. Am. Stat. Assoc.20029746010901098195126210.1198/0162145023886189061041.62098Hyttinen, A., Eberhardt, F., Järvisalo, M.: Constraint-based causal discovery: Conflict resolution with answer set programming. UAI (2014). http://www.its.caltech.edu/~fehardt/papers/HEJ_UAI2014.pdfIdekerTGalitskiTHoodLA new approach to decoding life: systems biologyAnnu. Rev. Genomics Hum. Genet.2001234337210.1146/annurev.genom.2.1.343KalischMMächlerMColomboDMaathuisMHBühlmannPCausal inference using graphical models with the R package pcalgJ. Stat. Softw.2012471112610.18637/jss.v047.i11KarpRMThe transitive closure of a random digraphRandom Struct. Algorithms1990117393106849210.1002/rsa.32400101060712.68076KemmerenPSameithKvan de PaschLALBenschopJJLenstraTLMargaritisTO’DuibhirEApweilerEvan WageningenSKoCWvan HeeschSKashaniMMAmpatziadis-MichailidisGBrokMOBrabersNACHMilesAJBouwmeesterDvan HooffSRvan BakelHSluitersEBakkerLVSnelBLijnzaadPvan LeenenDGroot KoerkampMJAHolstegeFCPLarge-scale genetic perturbations reveal regulatory networks and an abundance of gene-specific repressorsCell2014157374075210.1016/j.cell.2014.02.054KrivelevichMSudakovBThe phase transition in random graphs: a simple proofRandom Struct. Algorithms2013432131138308576510.1002/rsa.204701272.05181MaathuisMHKalischMBühlmannPEstimating high-dimensional intervention effects from observational dataAnn. Stat.2009376A31333164254955510.1214/09-AOS6851191.62118Magliacane, S., van Ommen, T.: Causal transfer learning (2017). https://staff.science.uva.nl/j.m.mooij/articles/1707.06422.pdfMagliacane, S., Claassen, T., Mooij, J.: Joint causal inference on observational and experimental datasets (2016a). https://staff.fnwi.uva.nl/j.m.mooij/articles/1611.10351v2.pdfMagliacane, S., Claassen, T., Mooij, J.M.: Ancestral causal inference. In: Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29. Curran Associates, Inc. (2016b). https://proceedings.neurips.cc/paper/2016/file/f3d9de86462c28781cbe5c47ef22c3e5-Paper.pdfMalinsky, D., Spirtes, P.: Estimating causal effects with ancestral graph Markov models. In: Conference on Probabilistic Graphical Models, pp. 299–309. PMLR (2016)MeinshausenNHauserAMooijJPetersJVersteegPBühlmannPMethods for causal inference from gene perturbation experiments and validationProc. Natl. Acad. Sci. U.S.A.2016113277361736810.1073/pnas.1510493113Milo, R., Kashtan, N., Itzkovitz, S., Newman, M.: On the uniform generation of random graphs with prescribed degree sequences (2003). https://arxiv.org/abs/cond-mat/0312028Mooij, J.M., Claassen, T.: Constraint-based causal discovery using partial ancestral graphs in the presence of cycles. In: Conference on Uncertainty in Artificial Intelligence, pp. 1159–1168. PMLR (2020)NewmanMEMixing patterns in networksPhys. Rev. E2003672197519310.1103/PhysRevE.67.026126NewmanMEGirvanMFinding and evaluating community structure in networksPhys. Rev. E200469210.1103/PhysRevE.69.026113NogueiraARPugnanaARuggieriSPedreschiDGamaJMethods and tools for causal discovery and causal inferenceWiley Interdiscip. Rev.: Data Min. Knowl. Discov.2022122O’Donnell, R.T., Korb, K.B., Allison, L.: Causal KL: evaluating causal discovery (2021). arXiv:2111.06029ParikshakNNGandalMJGeschwindDHSystems biology and gene networks in neurodevelopmental and neurodegenerative disordersNat. Rev. Genet.201516844145810.1038/nrg3934PearlJCausality2009CambridgeCambridge University Press10.1017/CBO97805118031611188.68291PetersJBühlmannPMeinshausenNCausal inference by using invariant prediction: identification and confidence intervalsJ. R. Stat. Soc.: Ser. B (Stat. Methodol.)20167859471012355718610.1111/rssb.121671414.62297PhillipsPCEpistasis-the essential role of gene interactions in the structure and evolution of genetic systemsNat. Rev. Genet.200891185586710.1038/nrg2452RauAJaffrézicFNuelGJoint estimation of causal effects from observational and intervention gene expression dataBMC Syst. Biol.2013711110.1186/1752-0509-7-111Richardson, T.: A discovery algorithm for directed cyclic graphs. In: Proceedings of the Twelfth International Conference on Uncertainty in Artificial Intelligence, pp. 454–461 (1996)Rothenhäusler, D., Bühlmann, P., Meinshausen, N.: Causal Dantzig: fast inference in linear structural equation models with hidden variables under additive interventions. Ann. Stat. 47(3), 1688–1722 (2019). https://doi.org/10.1214/18-AOS1732SachsKPerezOPe’erDLauffenburgerDANolanGPCausal protein-signaling networks derived from multiparameter single-cell dataScience2005308572152352910.1126/science.1105809SanguinettiGHuynh-ThuVAGene Regulatory Networks: Methods and Protocols2019New YorkSpringer10.1007/978-1-4939-8882-21417.92005ShalemOSanjanaNEZhangFHigh-throughput functional genomics using CRISPR-Cas9Nat. Rev. Genet.201516529931110.1038/nrg3899SpencerSEHillSMMukherjeeSInferring network structure from interventional time-course experimentsAnn. Appl. Stat.20159507524334112510.1214/15-AOAS8061454.62403Spirtes, P.: Introduction to causal inference. J. Mach. Learn. Res. 11(5) (2010)Spirtes, P., Glymour, C.N., Scheines, R., Heckerman, D.: Causation, Prediction, and Search. MIT Press, Cambridge (2000)UrsuONealJTSheaEThakorePIJerby-ArnonLNguyenLDionneDDiazCBaumanJMosaadMMMassively parallel phenotyping of coding variants in cancer with perturb-seqNat. Biotechnol.202240110WangYSolusLYangKUhlerCGuyonILuxburgUVBengioSWallachHFergusRVishwanathanSGarnettRPermutation-based causal inference algorithms with interventionsAdvances in Neural Information Processing Systems2017New YorkCurran Associates Inc.ZhangJCausal reasoning with ancestral graphsJ. Mach. Learn. Res.200891437147424260481225.68254Appendix A: ProofsAppendix A.1: Proof of Theorem <xref rid="FPar10" ref-type="">3.5</xref>
To prove Theorem 3.5 we need the following preliminary result.
Lemma 1
Let G=(V,E)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G=(V,E)$$\end{document} be such that E is drawn at random with marginal probabilitiesE[k,ℓ]∼δ(1)ifk=ℓB(1,q)else,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} E[k,\ell ]\sim {\left\{ \begin{array}{ll} \delta (1) &{} \text { if }k=\ell \\ B(1,q) &{} \text { else} \end{array}\right. }, \end{aligned}$$\end{document}where q∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\in (0,1)$$\end{document}, with E[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k,\ell ]$$\end{document} and E[k′,ℓ′]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k^\prime ,\ell ^\prime ]$$\end{document} drawn independently for all k,k′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime $$\end{document} and all ℓ≠ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell \ne {}\ell ^\prime $$\end{document}, and with a covariance structure given byCovE[k,ℓ],E[k′,ℓ]|(E[k~j,ℓ])j=1J=κN,J>0,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \text {Cov}\left( {}E[k,\ell ],E[k^\prime ,\ell ]\Big |(E[\tilde{k}_j,\ell ])_{j=1}^{J}\right) =\kappa _{N,J}>0\,, \end{aligned}$$\end{document}with N:=∑j=1JE[k~j,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$N:=\sum _{j=1}^JE[\tilde{k}_j,\ell ]$$\end{document}, for all ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell $$\end{document} and any pairwise distinct k,k′,k~1,⋯,k~J∈1,2,⋯,p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime ,\tilde{k}_1,\dots {},\tilde{k}_J\in \left\{ {}1,2,\dots {},p\right\} $$\end{document}.
First note that by construction we have for x,x~∈0,1|Q1|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\textbf {x}},\tilde{{\textbf {x}}}\in \left\{ {}0,1\right\} ^{|\mathcal {Q}_1|}$$\end{document} and y,y~∈0,1|Q2|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\textbf{y},\tilde{\textbf{y}}\in \left\{ {}0,1\right\} ^{|\mathcal {Q}_2|}$$\end{document} thatP(E[k,ℓ])k∈Q1=x|(E[r,ℓ])3∈Q2=y=P(E[k,ℓ′])k∈Q~1=x~|(E[r,ℓ′])r∈Q~2=y~.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ {}(E[k,\ell ])_{k\in \mathcal {Q}_1}=\textbf{x}\Big |(E[r,\ell ])_{3\in \mathcal {Q}_2}=\textbf{y}\right] \\&\quad =\mathbb {P}\left[ {}(E[k,\ell ^\prime ])_{k\in \widetilde{\mathcal {Q}}_1}=\tilde{\textbf{x}}\Big |(E[r,\ell ^\prime ])_{r\in \widetilde{\mathcal {Q}}_2}=\tilde{\textbf{y}}\right] \,. \end{aligned} \end{aligned}$$\end{document}Second, let ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell $$\end{document} and Q⊊1,⋯,p\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q}\subsetneq \left\{ {}1,\dots {},p\right\} $$\end{document} be arbitrary such that ℓ∉Q\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell \notin \mathcal {Q}$$\end{document}, and m=(mj)∈0,1|Q|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\textbf{m}=(m_j)\in \left\{ {}0,1\right\} ^{|\mathcal {Q}|}$$\end{document} a vector such that ∑jmj≥1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\sum _j{}m_j\ge {}1$$\end{document}. Suppose furthermore without loss of generality that 1∈Q\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$1\in {}\mathcal {Q}$$\end{document} and m1=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$m_1=1$$\end{document}. We have for ℓ≠k∉Q\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell \ne {}k\notin \mathcal {Q}$$\end{document} thatPE[k,ℓ]=1|(E[r,ℓ])r∈Q=m=PE[k,ℓ]=1,E[1,ℓ]=1|(E[r,ℓ])r∈Q\1=m~PE[1,ℓ]=1|(E[r,ℓ])r∈Q\1=m~,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ {}E[k,\ell ]=1|(E[r,\ell ])_{r\in {}\mathcal {Q}}=\textbf{m}\right] \\&\quad =\frac{\mathbb {P}\left[ {}E[k,\ell ]=1,E[1,\ell ]=1\Big |(E[r,\ell ])_{r\in {}\mathcal {Q}\setminus \left\{ {}1\right\} }=\tilde{\textbf{m}}\right] }{\mathbb {P}\left[ {}E[1,\ell ]=1\Big |(E[r,\ell ])_{r\in {}\mathcal {Q}\setminus {}\left\{ {}1\right\} }=\tilde{\textbf{m}}\right] }\,, \end{aligned} \end{aligned}$$\end{document}where m~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\tilde{\textbf{m}}$$\end{document} is the vector m\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\textbf{m}$$\end{document} without its first entry. For ease of notation denoteZ0=(E[r,ℓ])r∈Q\1=m~.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} Z_0=\left\{ {}(E[r,\ell ])_{r\in {}\mathcal {Q}\setminus \left\{ {}1\right\} }=\tilde{\textbf{m}}\right\} . \end{aligned}$$\end{document}Then, using (A1) we havePE[k,ℓ]=1,E[1,ℓ]=1|Z0PE[1,ℓ]=1|Z0>PE[k,ℓ]=1|Z0PE[1,ℓ]=1|Z0PE[1,ℓ]=1|Z0=PE[k,ℓ]=1|Z0PE[1,ℓ]=0|Z0PE[1,ℓ]=0|Z0>PE[k,ℓ]=1,E[1,ℓ]=0|Z0PE[1,ℓ]=0|Z0=PE[k,ℓ]=1|Z0andE[1,ℓ]=0.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned}&\frac{\mathbb {P}\left[ {}E[k,\ell ]=1,E[1,\ell ]=1|Z_0\right] }{\mathbb {P}\left[ {}E[1,\ell ]=1|Z_0\right] }\nonumber \\&\quad>\frac{\mathbb {P}\left[ {}E[k,\ell ]=1|Z_0\right] \mathbb {P}\left[ {}E[1,\ell ]=1|Z_0\right] }{\mathbb {P}\left[ {}E[1,\ell ]=1|Z_0\right] }\nonumber \\&\quad =\frac{\mathbb {P}\left[ {}E[k,\ell ]=1|Z_0\right] \mathbb {P}\left[ {}E[1,\ell ]=0|Z_0\right] }{\mathbb {P}\left[ {}E[1,\ell ]=0|Z_0\right] }\nonumber \\&\quad >\frac{\mathbb {P}\left[ {}E[k,\ell ]=1,E[1,\ell ]=0|Z_0\right] }{\mathbb {P}\left[ {}E[1,\ell ]=0|Z_0\right] }\nonumber \\&\quad =\mathbb {P}\left[ {}E[k,\ell ]=1|Z_0\text { and }E[1,\ell ]=0\right] \,. \end{aligned}$$\end{document}By symmetry of the covariance structure yielding (A3) we follow that for any k,k′,ℓ,ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime ,\ell ,\ell ^\prime $$\end{document} s.t. k≠ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\ne {}\ell $$\end{document} and k′≠ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k^\prime \ne \ell ^\prime $$\end{document} and subsets Q,Q~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q},\widetilde{\mathcal {Q}}$$\end{document} with |Q|=|Q~|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {Q}|=|\widetilde{\mathcal {Q}}|$$\end{document} thatPE[k,ℓ]=1|(E[r,ℓ])r∈Q=m>PE[k′,ℓ′]=1|(E[r,ℓ′])r∈Q~=m¯,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ {}E[k,\ell ]=1|(E[r,\ell ])_{r\in {}\mathcal {Q}}=\textbf{m}\right] \\&\quad >\mathbb {P}\left[ {}E[k^\prime ,\ell ^\prime ]=1|(E[r,\ell ^\prime ])_{r\in {}\widetilde{\mathcal {Q}}}=\bar{\textbf{m}}\right] \,, \end{aligned} \end{aligned}$$\end{document}if and only if||m||1>||m¯||1.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} ||\textbf{m}||_1>||\bar{\textbf{m}}||_1\,. \end{aligned}$$\end{document}In particular, by (A1) we have that if equality holds in (A6), equality holds in (A7), yielding the “if and only if” part of the statement.
Moreover, we obtain analogously the opposite statement that for any k,k′,ℓ,ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k,k^\prime ,\ell ,\ell ^\prime $$\end{document} s.t. k≠ℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\ne {}\ell $$\end{document} and k′≠ℓ′\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k^\prime \ne \ell ^\prime $$\end{document} and subsets Q,Q~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q},\widetilde{\mathcal {Q}}$$\end{document} with |Q|=|Q~|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {Q}|=|\widetilde{\mathcal {Q}}|$$\end{document} we havePE[k,ℓ]=0|(E[r,ℓ])r∈Q=m>PE[k′,ℓ′]=0|(E[r,ℓ′])r∈Q~=m¯,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ {}E[k,\ell ]=0|(E[r,\ell ])_{r\in {}\mathcal {Q}}=\textbf{m}\right] \\&\quad >\mathbb {P}\left[ {}E[k^\prime ,\ell ^\prime ]=0|(E[r,\ell ^\prime ])_{r\in {}\widetilde{\mathcal {Q}}}=\bar{\textbf{m}}\right] \,, \end{aligned} \end{aligned}$$\end{document}if and only if||m||1<||m¯||1.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} ||\textbf{m}||_1<||\bar{\textbf{m}}||_1. \end{aligned}$$\end{document}Again, with equality holding either in both, or in none of the equations by virtue of (A3).
Let us in the following assume without loss of generality by symmetry of the covariance structure and independence between columns that Qx=Q~x\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q}_x=\widetilde{\mathcal {Q}}_x$$\end{document} for x=1,2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x=1,2$$\end{document}.
The claim of Lemma 1 can now be proven via induction on the size of the set Q1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q}_1$$\end{document}, while keeping Q2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q}_2$$\end{document} fixed. To this end, ℓ,ℓ′,m,m¯,Q1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell ,\ell ^\prime ,\textbf{m},\bar{\textbf{m}},\mathcal {Q}_1$$\end{document} and Q2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {Q}_2$$\end{document} be as in the assumption (including ℓ′∉Q1,Q2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ell ^\prime \notin \mathcal {Q}_1,\mathcal {Q}_2$$\end{document}). We initialize the induction hypothesis with |Q1|=|k|=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {Q}_1|=|\left\{ {}k\right\} |=1$$\end{document}. DefineA:=P[E[k,ℓ]>E[k,ℓ′]|E[r,ℓ]r∈Q2=m,E[r,ℓ′]r∈Q2=m¯]=PE[k,ℓ]=1|E[r,ℓ]r∈Q2=m×PE[k,ℓ′]=0|E[r,ℓ′]r∈Q2=m¯.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} A&:=\mathbb {P}\Big [E[k,\ell ]>E[k,\ell ^\prime ]\Big |\\&\qquad \qquad \left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m},\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\Big ]\\&=\mathbb {P}\left[ {}E[k,\ell ]=1\Big |\left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m}\right] \\&\quad \times \mathbb {P}\left[ {}E[k,\ell ^\prime ]=0\Big |\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\right] . \end{aligned} \end{aligned}$$\end{document}In the case ||m||1>||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1>||\bar{\textbf{m}}||_1$$\end{document} we have by (A6) and (A8) thatA>PE[k,ℓ′]=1|E[r,ℓ′]r∈Q2=m¯×PE[k,ℓ]=0|E[r,ℓ]r∈Q2=m=P[E[k,ℓ]<E[k,ℓ′]|E[r,ℓ]r∈Q2=m,E[r,ℓ′]r∈Q2=m¯].\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} A&>\mathbb {P}\left[ {}E[k,\ell ^\prime ]=1\Big |\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\right] \\&\quad \times \mathbb {P}\left[ {}E[k,\ell ]=0\Big |\left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m}\right] \\&=\mathbb {P}\Big [E[k,\ell ]<E[k,\ell ^\prime ]\Big |\\&\qquad \qquad \left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m},\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\Big ]\,. \end{aligned} \end{aligned}$$\end{document}In the same way we have that if ||m||1=||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1=||\bar{\textbf{m}}||_1$$\end{document} we obtain equality in (A9) by using that equality in (A7) yields equality in (A6), yielding the base case of the induction.
It remains to show the induction step. Let the claim be shown for |Q1|=N∈N\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {Q}_1|=N\in \mathbb {N}$$\end{document} and consider now |Q1|=|k1,⋯,kN+1|=N+1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {Q}_1|=|\left\{ {}k_1,\dots {},k_{N+1}\right\} |=N+1$$\end{document} and ||m||1>||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1>||\bar{\textbf{m}}||_1$$\end{document}. For ease of notation let us define for x,y=0,1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x,y=0,1$$\end{document} the eventsZ:=E[r,ℓ]r∈Q2=m,E[r,ℓ′]r∈Q2=m¯,Z~(x,y):=E[kN+1,ℓ]=x,E[kN+1,ℓ′]=y,Z(x,y):=Z∩Z~(x,y).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} Z&:=\left\{ \left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}={\textbf {m}},\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{{\textbf {m}}}\right\} ,\\ \tilde{Z}_{(x,y)}&:=\left\{ {}E[k_{N+1},\ell ]=x,E[k_{N+1},\ell ^\prime ]=y\right\} ,\\ Z_{(x,y)}&:=Z\cap \tilde{Z}_{(x,y)}. \end{aligned} \end{aligned}$$\end{document}We haveB:=P[∑n=1N+1E[kn,ℓ]>∑n=1N+1E[kn,ℓ′]|E[r,ℓ]r∈Q2=m,E[r,ℓ′]r∈Q2=m¯]=P∑n=1NE[kn,ℓ]>∑n=1NE[kn,ℓ′]|Z(0,0)⏟:=P(0,0)PZ~(0,0)|Z+P∑n=1NE[kn,ℓ]>∑n=1NE[kn,ℓ′]|Z(1,1)⏟:=P(1,1)PZ~(1,1)|Z+P∑n=1NE[kn,ℓ]≥∑n=1NE[kn,ℓ′]|Z(1,0)⏟:=P(1,0)PZ~(1,0)|Z+P∑n=1NE[kn,ℓ]>1+∑n=1NE[kn,ℓ′]|Z(0,1)⏟:=P(0,1)PZ~(0,1)|Z\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} B&:=\mathbb {P}\Bigg [\sum _{n=1}^{N+1}E[k_n,\ell ]>\sum _{n=1}^{N+1}E[k_n,\ell ^\prime ]\Bigg |\\&\qquad \qquad \left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m},\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\Bigg ]\\&=\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]>\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,0)}\right] }_{:=P_{(0,0)}}\mathbb {P}\left[ {}\tilde{Z}_{(0,0)}\Big |Z\right] \\&\quad +\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]>\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,1)}\right] }_{:=P_{(1,1)}}\mathbb {P}\left[ {}\tilde{Z}_{(1,1)}\Big |Z\right] \\&\quad +\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]\ge {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] }_{:=P_{(1,0)}}\mathbb {P}\left[ {}\tilde{Z}_{(1,0)}\Big |Z\right] \\&\quad +\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]>1+\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] }_{:=P_{(0,1)}}\mathbb {P}\left[ {}\tilde{Z}_{(0,1)}\Big |Z\right] \end{aligned} \end{aligned}$$\end{document}Using the induction assumption we have immediatelyP(0,0)>P∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(0,0),P(1,1)>P∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(1,1).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} P_{(0,0)}&>\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,0)}\right] \,,\\ P_{(1,1)}&>\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,1)}\right] \,. \end{aligned} \end{aligned}$$\end{document}Moreover we obtain by induction assumption as ||m||1+1>||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1+1>||\bar{\textbf{m}}||_1$$\end{document} thatP(1,0)>P∑n=1NE[kn,ℓ]≤∑n=1NE[kn,ℓ′]|Z(1,0)=P1+∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(1,0)+P∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′]|Z(1,0)⏟:=γ1+P1+∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′]|Z(1,0)⏟:=γ2,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} P_{(1,0)}&>\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]\le {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] \\&=\mathbb {P}\left[ {}1+\sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] \\&\quad {}+\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] }_{:=\gamma _1}\\&\quad {}+\underbrace{\mathbb {P}\left[ {}1+\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] }_{:=\gamma _2}\,, \end{aligned} \end{aligned}$$\end{document}and by ||m||1≥||m¯||1+1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1\ge {}||\bar{\textbf{m}}||_1+1$$\end{document} we have,P(0,1)=P∑n=1NE[kn,ℓ]>∑n=1NE[kn,ℓ′]|Z(0,1)-P∑n=1NE[kn,ℓ]=1+∑n=1NE[kn,ℓ′]|Z(0,1)≥P∑n=1NE[kn,ℓ]≤∑n=1NE[kn,ℓ′]|Z(0,1)-P∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′]|Z(0,1)⏟:=γ~1-P∑n=1NE[kn,ℓ]=1+∑n=1NE[kn,ℓ′]|Z(0,1)⏟:=γ~2,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} P_{(0,1)}&=\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]>{}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] \\&\quad {}-\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]=1+\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] \\&\ge \mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]\le {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] \\&\quad {}-\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] }_{:=\tilde{\gamma }_1}\\&\quad {}-\underbrace{\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]=1+\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] }_{:=\tilde{\gamma }_2}\,, \end{aligned} \end{aligned}$$\end{document}Now we need to show thatPZ~(1,0)|Zγ1+γ2-PZ~(0,1)|Zγ~1+γ~2≥0,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ \tilde{Z}_{(1,0)}\Big |Z\right] \left( {}\gamma _1+\gamma _2\right) -\mathbb {P}\left[ \tilde{Z}_{(0,1)}\Big |Z\right] \left( \tilde{\gamma }_1+\tilde{\gamma }_2\right) \ge {}0, \end{aligned} \end{aligned}$$\end{document}in order that we can drop it. We start by using the induction assumption to show:PZ~(1,0)|Zγ1=P∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′],Z~(1,0)|Z=PZ~(1,0)|∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′],Z×P∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′]|Z>PZ~(0,1)|∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′],Z×P∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′]|Z=PZ~(0,1)|Zγ~1.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ \tilde{Z}_{(1,0)}\Big |Z\right] \gamma _1\\&=\mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }],\tilde{Z}_{(1,0)}\bigg |Z\right] \\&=\mathbb {P}\left[ {}\tilde{Z}_{(1,0)}\bigg |\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }],Z\right] \\&\qquad \times {}\mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }]\bigg |Z\right] \\&>\mathbb {P}\left[ {}\tilde{Z}_{(0,1)}\bigg |\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }],Z\right] \\&\qquad \times {}\mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }]\bigg |Z\right] \\&=\mathbb {P}\left[ \tilde{Z}_{(0,1)}\Big |Z\right] \tilde{\gamma }_1\,. \end{aligned} \end{aligned}$$\end{document}For the second term we use the symmetry of the covariance structure, yielding (A3), and the independence between the columns of the edge matrix:PZ~(1,0)|Zγ2=P1+∑n=1NE[kn,ℓ]=∑n=1NE[kn,ℓ′],Z~(1,0)|Z=∑t=0N-1P∑n=1NE[kn,ℓ]=t,E[kN+1,ℓ]=1|Z×P∑n=1NE[kn,ℓ′]=t+1,E[kN+1,ℓ′]=0|Z=∑t=0N-1P∑n=1NE[kn,ℓ′]=t,E[kN+1,ℓ′]=1|Z×P∑n=1NE[kn,ℓ]=t+1,E[kN+1,ℓ]=0|Z=PZ~(0,1)|Zγ~2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ \tilde{Z}_{(1,0)}\Big |Z\right] \gamma _2\\&=\mathbb {P}\left[ {}1+\sum _{n=1}^{N}E[k_n,\ell ]=\sum _{n=1}^{N}E[k_n,\ell ^{\prime }],\tilde{Z}_{(1,0)}\bigg |Z\right] \\&=\sum _{t=0}^{N-1}\left( \mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]=t,E[k_{N+1},\ell ]=1\bigg |Z\right] \right. \\&\qquad {}\left. \times \mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ^{\prime }]=t+1,E[k_{N+1},\ell ^\prime ]=0\bigg |Z\right] \right) \\&=\sum _{t=0}^{N-1}\left( \mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]=t,E[k_{N+1},\ell ^\prime ]=1\bigg |Z\right] \right. \\&\qquad {}\left. \times \mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]=t+1,E[k_{N+1},\ell ]=0\bigg |Z\right] \right) \\&=\mathbb {P}\left[ \tilde{Z}_{(0,1)}\Big |Z\right] \tilde{\gamma }_2 \end{aligned} \end{aligned}$$\end{document}Using (A14) and (A15) and plugging (A11), (A12) and (A13) in (A10) we getB>P∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(0,0)PZ~(0,0)|Z+P∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(1,1)PZ~(1,1)|Z+P1+∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(1,0)PZ~(1,0)|Z+P∑n=1NE[kn,ℓ]≤∑n=1NE[kn,ℓ′]|Z(0,1)PZ~(0,1)|Z=P[∑n=1N+1E[kn,ℓ]<∑n=1N+1E[kn,ℓ′]|E[r,ℓ]r∈Q2=m,E[r,ℓ′]r∈Q2=m¯],\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} B&>\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,0)}\right] \mathbb {P}\left[ {}\tilde{Z}_{(0,0)}\Big |Z\right] \\&\quad +\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,1)}\right] \mathbb {P}\left[ {}\tilde{Z}_{(1,1)}\Big |Z\right] \\&\quad +\mathbb {P}\left[ {}1+\sum _{n=1}^{N}E[k_n,\ell ]<\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] \mathbb {P}\left[ {}\tilde{Z}_{(1,0)}\Big |Z\right] \\&\quad +\mathbb {P}\left[ \sum _{n=1}^{N}E[k_n,\ell ]\le {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] \mathbb {P}\left[ {}\tilde{Z}_{(0,1)}\Big |Z\right] \\&=\mathbb {P}\Bigg [\sum _{n=1}^{N+1}E[k_n,\ell ]<\sum _{n=1}^{N+1}E[k_n,\ell ^\prime ]\Bigg |\\&\qquad \left( {}E[r,\ell ]\right) _{r\in {}\mathcal {Q}_2}=\textbf{m},\left( {}E[r,\ell ^\prime ]\right) _{r\in {}\mathcal {Q}_2}=\bar{\textbf{m}}\Bigg ]\,, \end{aligned} \end{aligned}$$\end{document}showing the induction step for ||m||1>||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1>||\bar{\textbf{m}}||_1$$\end{document}. Which leaves the case ||m||1=||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1=||\bar{\textbf{m}}||_1$$\end{document}. First, by induction assumption we have equality in both displays of (A11). Second, by (A3) and symmetry of construction we have thatPZ~(1,0)|Z=PZ~(0,1)|Z,P(1,0)=P∑n=1NE[kn,ℓ]≤∑n=1NE[kn,ℓ′]|Z(0,1),P(0,1)=P1+∑n=1NE[kn,ℓ]<∑n=1NE[kn,ℓ′]|Z(1,0).\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned}&\mathbb {P}\left[ \tilde{Z}_{(1,0)}\Big |Z\right] =\mathbb {P}\left[ \tilde{Z}_{(0,1)}\Big |Z\right] ,\\&P_{(1,0)}=\mathbb {P}\left[ {}\sum _{n=1}^{N}E[k_n,\ell ]\le {}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(0,1)}\right] ,\\&P_{(0,1)}=\mathbb {P}\left[ {}1+\sum _{n=1}^{N}E[k_n,\ell ]<{}\sum _{n=1}^{N}E[k_n,\ell ^\prime ]\Bigg |Z_{(1,0)}\right] . \end{aligned} \end{aligned}$$\end{document}Hence, putting both observations together we have equality in (A16) for ||m||1=||m¯||1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$||\textbf{m}||_1=||\bar{\textbf{m}}||_1$$\end{document}, finishing the proof.
Appendix A.3: Proof of Lemma <xref rid="FPar20" ref-type="">3.15</xref>Proof
Assume that E is not symmetric: Let vk,vℓ∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k,v_\ell \in {}V$$\end{document} such that E[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[k,\ell ]=1$$\end{document} and E[ℓ,k]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[\ell ,k]=0$$\end{document}. Since G is transitively closed we have Pk⊂Pℓ\vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {P}_k\subset {}\mathcal {P}_\ell \setminus \left\{ {}v_k\right\} $$\end{document}, where Pk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {P}_k$$\end{document} is the set of parents of the node vk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k$$\end{document}. Yielding deg-(vk)≤deg-(vℓ)-1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-(v_k)\le {}\text {deg}^-(v_\ell )-1$$\end{document}, a contradiction to the assumption deg-(vk)=deg-(vℓ)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-(v_k)=\text {deg}^-(v_\ell )$$\end{document}. Hence if Assumption 3.3 holds, E is symmetric. By G being transitively closed we have Ak=Pk=Dk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_k=\mathcal {P}_k=\mathcal {D}_k$$\end{document}, where Ak\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_k$$\end{document} and Dk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {D}_k$$\end{document} denote the respective sets of ancestors and descendants, for every vk∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k\in {}V$$\end{document}. Hence, for any vk∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k\in {}V$$\end{document} we have that vk∪Pk\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}v_k\right\} \cup \mathcal {P}_k$$\end{document} form a connected component and a complete subgraph, yielding the claim by the fact that deg-\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\text {deg}^-$$\end{document} is constant on V.
Appendix A.4: Proof of Corollary <xref rid="FPar23" ref-type="">3.18</xref>Proof
By definition of θTAP(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)$$\end{document} we have that from ΘTAP(EX)[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Theta _{\text {TAP}}(E_X) [k,\ell ]=0$$\end{document} follows θTAP(EX)[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)[k,\ell ]=0$$\end{document}, yielding one direction. For the other direction consider E~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widetilde{E}$$\end{document} from the proof of Lemma 3.13 to yield θTAP(EX)[k,ℓ]>0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)[k,\ell ]>0$$\end{document} if Avk⊆Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_{v_k}\subseteq {}\mathcal {A}_{v_\ell }$$\end{document}.
Appendix A.5: Proof of Lemma <xref rid="FPar24" ref-type="">3.19</xref>Proof
Let [k,ℓ]∈S2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]\in {}S_2$$\end{document} be an edge with Avk⊆Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_{v_k}\subseteq {}\mathcal {A}_{v_\ell }$$\end{document}. DefineΦ1:=E0∈X(V,EX):E0[k,ℓ]=1,Φ2:=E0∈X(V,EX):E0[k,ℓ]=0,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \Phi _1:=\left\{ {}E_0\in \mathcal {X}(V,E_X):E_{0}[k,\ell ]=1\right\} ,\\ \Phi _2:=\left\{ {}E_0\in \mathcal {X}(V,E_X):E_{0}[k,\ell ]=0\right\} ,\\ \end{aligned} \end{aligned}$$\end{document}Let M∈Φ2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M\in \Phi _2$$\end{document}, then we define by M+[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_{+[k,\ell ]}$$\end{document} the edge matrix withM+[k,ℓ][r,s]:=1if[r,s]=[k,ℓ]M[r,s]else,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} M_{+[k,\ell ]}[r,s]:={\left\{ \begin{array}{ll} 1 &{} \text { if }[r,s]=[k,\ell ]\\ M[r,s] &{} \text {else} \end{array}\right. }\,, \end{aligned}$$\end{document}i.e. adding the edge [k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]$$\end{document} to M. Note that by definition of Φ2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\Phi _2$$\end{document} we have M[k,ℓ]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M[k,\ell ]=0$$\end{document}. Define furthermore a mappingϕ:Φ2→Φ1,ϕ:M↦M+[k,ℓ].\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \phi :\Phi _2\rightarrow \Phi _1,\quad {}\phi :M\mapsto {}M_{+[k,\ell ]}. \end{aligned}$$\end{document}Since M∈X(V,EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M\in \mathcal {X}(V,E_X)$$\end{document} and Avk⊆Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {A}_{v_k}\subseteq {}\mathcal {A}_{v_\ell }$$\end{document} adding the edge [k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]$$\end{document} will not interfere with the zero-constraints given by (3.11) and as adding edges can never interfere with the ≠0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\ne 0$$\end{document} constraints in (3.12), we have M+[k,ℓ]∈X(V,EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_{+[k,\ell ]}\in \mathcal {X}(V,E_X)$$\end{document} and thus ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document} is well-defined. Moreover, ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document} is by definition injective.
Given Avk\vℓ∩Avℓ=∅\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left( \mathcal {A}_{v_k}\setminus {}\left\{ {}v_\ell \right\} \right) \cap \mathcal {A}_{v_\ell }=\emptyset $$\end{document} we define additionallyψ:Φ1→Φ2,ψ:M↦M-[k,ℓ],\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \psi :\Phi _1\rightarrow \Phi _2,\quad {}\psi :M\mapsto {}M_{-[k,\ell ]}, \end{aligned}$$\end{document}with M-[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_{-[k,\ell ]}$$\end{document} being defined as in A34 with M[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M[k,\ell ]$$\end{document} set to 0, i.e. deleting the edge [k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]$$\end{document} from M. If deleting the edge [k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[k,\ell ]$$\end{document} would break a path from vr\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_{r}$$\end{document} with r∈I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$r\in \mathcal {I}$$\end{document} to vs∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_s\in {}V$$\end{document} we would have vk,vℓ∈Dvr\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_k,v_\ell \in \mathcal {D}_{v_r}$$\end{document} since k∉I\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k\notin {}\mathcal {I}$$\end{document}, a contradiction to (Avk\vℓ)∩Avℓ=∅\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(\mathcal {A}_{v_k}\setminus \left\{ {}v_\ell \right\} )\cap \mathcal {A}_{v_\ell }=\emptyset $$\end{document}. Hence, ψ(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\psi (E_X)$$\end{document} is well defined, since deleting an edge can not interfere with the zero-constraints given by EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document}. By definition ψ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\psi $$\end{document} is the inverse function of ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document}, making ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document} a bijection. Hence, we haveθTAP(EX)[k,ℓ]=12.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \theta _{\text {TAP}}(E_X)[k,\ell ]=\frac{1}{2}. \end{aligned}$$\end{document}Vice versa, if there were to exist vr∈Avk\vℓ∩Avℓ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_r\in \left( \mathcal {A}_{v_k}\setminus \left\{ {}v_\ell \right\} \right) \cap \mathcal {A}_{v_\ell }$$\end{document} define M0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_0$$\end{document} byM0[x,y]=1ifx∈I,vy∈Avxand[x,y]≠[r,ℓ]1if[x,y]=[k,ℓ]0else.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} M_0[x,y]={\left\{ \begin{array}{ll} 1 &{}\text { if }x\in \mathcal {I},\,v_y\in \mathcal {A}_{v_x}\text { and }[x,y]\ne {}[r,\ell ]\\ 1 &{}\text { if }[x,y]=[k,\ell ]\\ 0 &{}\text { else} \end{array}\right. }. \end{aligned}$$\end{document}Then by definition M0∈Φ1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_0\in \Phi _1$$\end{document}, but (M0)-(v,w)∉X(V,EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$(M_0)_{-(v,w)}\notin \mathcal {X}(V,E_X)$$\end{document}, hence M0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$M_0$$\end{document} is not in the image of ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document}, yielding by injectivity of ϕ\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\phi $$\end{document},#Φ1>#Φ2,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \#\Phi _1>\#\Phi _2, \end{aligned}$$\end{document}i.e. θTAP[k,ℓ](EX)>12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}[k,\ell ](E_X)>\frac{1}{2}$$\end{document}.
Appendix A.6: Computation of the example
Consider G and EX\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X$$\end{document} of the Example in Sect. 3.2 detailed in Fig. 2a. We have by Lemma 3.19 thatθTAP(EX)[2,1]=θTAP(EX)[3,1]=θTAP(EX)[4,1]=θTAP(EX)[4,2]=θTAP(EX)[4,3]=12.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \theta _{\text {TAP}}(E_X)[2,1]&=\theta _{\text {TAP}}(E_X)[3,1]\\&=\theta _{\text {TAP}}(E_X)[4,1]\\&=\theta _{\text {TAP}}(E_X)[4,2]\\&=\theta _{\text {TAP}}(E_X)[4,3]=\frac{1}{2}. \end{aligned} \end{aligned}$$\end{document}Moreover, we can compute by Fig. 2b that θTAP(EX)[2,3]=θTAP(EX)[3,2]=58\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)[2,3]=\theta _{\text {TAP}}(E_X)[3,2]=\nicefrac {5}{8}$$\end{document} and θTAP(EX)[1,2]=θTAP(EX)[1,3]=68\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {TAP}}(E_X)[1,2]=\theta _{\text {TAP}}(E_X)[1,3]=\nicefrac {6}{8}$$\end{document}. Last, by Corollary 3.18 we have that the edge matrix entries [1, 4], [2, 4] and [3, 4] are zero, yielding(θTAP(EX)[k,ℓ])k,ℓ=14=188660485045804448.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} (\theta _{\text {TAP}}(E_X)[k,\ell ])_{k,\ell =1}^4=\frac{1}{8}\begin{pmatrix} 8 &{} 6 &{} 6 &{} 0 \\ 4 &{} 8 &{} 5 &{} 0 \\ 4 &{} 5 &{} 8 &{} 0 \\ 4 &{} 4 &{} 4 &{} 8 \end{pmatrix}. \end{aligned}$$\end{document}As given in Fig. 2b the edge matrix entries [1,2],[1,3],[2,3],[3,2]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\left\{ {}[1,2],[1,3],[2,3],[3,2]\right\} $$\end{document} of an edge matrix E0∈X(V,EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0\in \mathcal {X}(V,E_X)$$\end{document} have 8 different possible configurations. Additionally, the five edge matrix entries [2, 1], [3, 1], [4, 1], [4, 2], [4, 3] can be in 25=32\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$2^{5}=32$$\end{document} different configurations. Hence, we have #X(V,EX)=32·8=256\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\#\mathcal {X}(V,E_X)=32\cdot {}8=256$$\end{document}. In the following we collect for each edge all graphs E∈X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E\in \mathcal {X}$$\end{document} featuring the given edge in their respective transitive closure.
All 128 edge matrices with E[2,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=1$$\end{document}.
Among the 128 edge matrices with E[2,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=0$$\end{document}, there is none with E[2,4]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,4]=1$$\end{document}, and there are 58·128=80\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {5}{8}\cdot {}128=80$$\end{document} with E[2,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=1$$\end{document}. Among those 80 we have 40 with E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=1$$\end{document}.
Among the remaining 40 with E[2,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=1$$\end{document} and E[2,1]=E[3,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=E[3,1]=0$$\end{document} we have none with E[3,4]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,4]=1$$\end{document}.
All 128 edge matrices with E[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=1$$\end{document}.
Among the 128 edge matrices with E[4,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=0$$\end{document} we have 64 graphs with E[4,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=1$$\end{document} from which...
... 32 feature E[2,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=0$$\end{document}. Of those there are
58·32=20\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {5}{8}\cdot {}32=20$$\end{document} which feature E[2,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=1$$\end{document}. And half of those 20 feature E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=1$$\end{document}. Hence, there are 10 additional edge matrices with E+[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[4,1]=1$$\end{document}.
Of the remaining 12 which feature E[2,3]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=0$$\end{document} we have 3 featuring E[4,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=E[3,1]=1$$\end{document}.
Among the 64 with E[4,1]=E[4,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=E[4,2]=0$$\end{document} there are 32 with E[4,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=1$$\end{document} from which...
All 128 edge matrices with E[4,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=1$$\end{document}.
Among the 128 graphs with E[4,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=0$$\end{document} we have 64 graphs with E[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=1$$\end{document}, yielding E+[4,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[4,2]=1$$\end{document} from the constraint E+[1,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[1,2]=1$$\end{document}.
Among the 64 with E[4,1]=E[4,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=E[4,2]=0$$\end{document} there are 32 with E[4,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=1$$\end{document} from which...
By symmetry we obtain(ΘTAP(EX)[k,ℓ])k,ℓ=14=1256256256256016825620801682082560194218218256.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} (\Theta _{\text {TAP}}(E_X)[k,\ell ])_{k,\ell =1}^4=\frac{1}{256}\begin{pmatrix} 256 &{} 256 &{} 256 &{} 0 \\ 168 &{} 256 &{} 208 &{} 0 \\ 168 &{} 208 &{} 256 &{} 0 \\ 194 &{} 218 &{} 218 &{} 256 \end{pmatrix}. \end{aligned}$$\end{document}To compute ΘB-TAP(0.5)(EX)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\scriptstyle {\Theta _{{\text {B-TAP}}}^{(0.5)}(E_X)}$$\end{document} consider the three spanning trees ensuring edges in [1, 2] and [1, 3] given in Fig. 2c. Each exists with probability 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document}, all other edges are than added on with a probability of 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document}. Hence, we have that θB-TAP(EX)[k,ℓ]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\theta _{\text {B-TAP}}(E_X)[k,\ell ]$$\end{document} denoting the marginal distribution of E0[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_0[k,\ell ]=1$$\end{document} is given by(θB-TAP(EX)[k,ℓ])k,ℓ=14=166550364034603336\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} (\theta _{\text {B-TAP}}(E_X)[k,\ell ])_{k,\ell =1}^4=\frac{1}{6}\begin{pmatrix} 6 &{} 5 &{} 5 &{} 0 \\ 3 &{} 6 &{} 4 &{} 0 \\ 3 &{} 4 &{} 6 &{} 0 \\ 3 &{} 3 &{} 3 &{} 6 \end{pmatrix} \end{aligned}$$\end{document}Let us now count how often we draw a graph featuring E+[k,ℓ]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[k,\ell ]=1$$\end{document} for Algorithm 2.
ΘB-TAP(EX)[2,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\varvec{\Theta }}_{{\text {B-TAP}}}\mathbf {(E_X)[2,1]}$$\end{document}: When drawing E there is a 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} probability that E[2,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=1$$\end{document}. Given E[2,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=0$$\end{document} we have...
... with probability 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document} that the spanning tree T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}$$\end{document} features [2,3]∈T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\in \mathcal {T}$$\end{document}. Then, with probability 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} we have E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=1$$\end{document} (yielding an additional 112\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{12}$$\end{document}). If, however E[3,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=0$$\end{document}, by E[2,4]=E[3,4]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,4]=E[3,4]=0$$\end{document} we have E+[2,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[2,1]=0$$\end{document}.
... with probability 23\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {2}{3}$$\end{document} that the spanning tree T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}$$\end{document} features [2,3]∉T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\notin \mathcal {T}$$\end{document}. Then, with probability 14\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{4}$$\end{document} we have E[2,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=E[3,1]=1$$\end{document} (yielding an additional 112\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{12}$$\end{document}). If, however either E[3,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=0$$\end{document} or E[2,3]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=0$$\end{document}, by E[2,4]=E[3,4]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,4]=E[3,4]=0$$\end{document} we have E+[2,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[2,1]=0$$\end{document}.
Yielding in total a probability of ΘB-TAP(EX)[2,1]=24+4+448=3248.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} {\Theta }_{{\text {B-TAP}}}(E_X)[2,1]=\frac{24+4+4}{48}=\frac{32}{48}. \end{aligned}$$\end{document}
ΘB-TAP(EX)[4,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\varvec{\Theta }}_{{\text {B-TAP}}}\mathbf {(E_X)[4,1]}$$\end{document}: When drawing E there is a 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} probability that E[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=1$$\end{document}. Given E[4,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=0$$\end{document} we have...
... with probability 14\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{4}$$\end{document} that E[4,2]=E[2,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=E[2,1]=1$$\end{document} (yielding an additional 18\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{8}$$\end{document}). However, if E[4,2]=1≠0=E[2,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=1\ne {}0=E[2,1]$$\end{document} we have with probability 16\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{6}$$\end{document} that [2,3]∈T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\in \mathcal {T}$$\end{document} and E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=1$$\end{document} (yielding an additional 148\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{48}$$\end{document}), or, with probability 16\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{6}$$\end{document} that [2,3]∉T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\notin \mathcal {T}$$\end{document}, but E[2,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=E[3,1]=1$$\end{document} (yielding an additional 148\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{48}$$\end{document}), or last, we have with probability 112\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{12}$$\end{document} that [2,3]∉T,E[2,3]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\notin {}\mathcal {T},E[2,3]=0$$\end{document} and E[4,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=E[3,1]=1$$\end{document} (yielding an additional 196\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{96}$$\end{document}).
... with probability 18\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{8}$$\end{document} that E[4,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=0$$\end{document}, but E[4,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=E[3,1]=1$$\end{document} (yielding an additional 116\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{16}$$\end{document}). However, if E[3,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[3,1]=0$$\end{document} we have as above with probability 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document} that E[2,3]=E[2,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=E[2,1]=1$$\end{document} (yielding an additional 148\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{48}$$\end{document}).
Yielding in total a probability of ΘB-TAP(EX)[4,1]=48+12+2+2+1+6+296=7396.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} {\Theta }_{{\text {B-TAP}}}(E_X)[4,1]&=\frac{48+12+2+2+1+6+2}{96}\\&=\frac{73}{96}. \end{aligned} \end{aligned}$$\end{document}
ΘB-TAP(EX)[4,2]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\varvec{\Theta }}_{{\text {B-TAP}}}\mathbf {(E_X)[4,2]}$$\end{document}: When drawing E there is a 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} probability that E[4,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=1$$\end{document}. Given E[4,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,2]=0$$\end{document} we have...
... with probability 23\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {2}{3}$$\end{document} that [1,2]∈T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[1,2]\in \mathcal {T}$$\end{document} (which automatically means [3,2]∉T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[3,2]\notin \mathcal {T}$$\end{document}). Then, with probability 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} we have E[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=1$$\end{document} (yielding an additional 16\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{6}$$\end{document}), with probability 18\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{8}$$\end{document} that E[4,1]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=0$$\end{document} and E[4,3]=E[3,2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=E[3,2]=1$$\end{document} (yielding an additional 124\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{24}$$\end{document}) and with probability 116\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{16}$$\end{document} we have E[4,1]=E[3,2]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=E[3,2]=0$$\end{document} and E[4,3]=E[3,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=E[3,1]=1$$\end{document} (yielding an additional 148\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{48}$$\end{document}).
... with probability 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document} that T=[1,3][3,2]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {T}=\left\{ {}[1,3][3,2]\right\} $$\end{document}. Then, with probability 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} we have E[4,3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=1$$\end{document} (yielding an additional 112\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{12}$$\end{document}), with probability 14\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{4}$$\end{document} that E[4,3]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,3]=0$$\end{document} and E[4,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[4,1]=1$$\end{document} (yielding an additional 124\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{24}$$\end{document}).
Yielding in total a probability of ΘB-TAP(EX)[4,2]=24+8+2+1+4+248=4148.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} {\Theta }_{{\text {B-TAP}}}(E_X)[4,2]=\frac{24+8+2+1+4+2}{48}=\frac{41}{48}. \end{aligned}$$\end{document}
ΘB-TAP(EX)[2,3]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$${\varvec{\Theta }}_{{\text {B-TAP}}}\mathbf {(E_X)[2,3]}$$\end{document}: When drawing E there is...
... a 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document} probability that [2,3]∈T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\in \mathcal {T}$$\end{document}.
... a 13\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{3}$$\end{document} probability that [2,3]∉T\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$[2,3]\notin \mathcal {T}$$\end{document} and E[2,3]=0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,3]=0$$\end{document}. Then, with probability 12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{2}$$\end{document} we have E[2,1]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[2,1]=1$$\end{document} (yielding an additional 16\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {1}{6}$$\end{document}).
Yielding in total a probability of ΘB-TAP(EX)[4,2]=16+16+848=4048.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} {\Theta }_{{\text {B-TAP}}}(E_X)[4,2]=\frac{16+16+8}{48}=\frac{40}{48}. \end{aligned}$$\end{document}
Appendix A.6: Proof of Lemma <xref rid="FPar29" ref-type="">3.22</xref>Proof
Let Gq\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$G_q$$\end{document} be an ancestral causal graph with node set Vs:=v0,v1,v2,v3,w0,w1,⋯,ws\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$V_s:=\left\{ {}v_0,v_1,v_2,v_3,w_0,w_1,\dots {},w_s\right\} $$\end{document} for s≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s\ge {}2$$\end{document}. The set of available interventions is given by I=v0,v3,w0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {I}=\left\{ {}v_0,v_3,w_0\right\} $$\end{document} and the partial observation EX(s)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_X^{(s)}$$\end{document} is given byE[v0,vk]=1fork=1,2,3,E[vℓ,wk]=0forℓ=0,3andk=0,1,⋯,s,E[v3,vk]=0fork=0,1,E[v3,v2]=1,E[w0,vk]=0fork=0,1,2,3,E[w0,wk]=1fork=1,⋯,s,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} E[v_0,v_k]&=1\quad \text {for }k=1,2,3,\\ E[v_\ell ,w_k]&=0\quad \text {for }\ell =0,3\text { and }k=0,1,\dots {},s,\\ E[v_3,v_k]&=0\quad {}\text {for }k=0,1,\\ E[v_3,v_2]&=1,\\ E[w_0,v_k]&=0\quad \text {for }k=0,1,2,3,\\ E[w_0,w_k]&=1\quad \text {for }k=1,\dots {},s,\\ \end{aligned} \end{aligned}$$\end{document}by abuse of notation. We observe the following impossible edges by Lemma 3.13K={[vk,wℓ]:∀k,ℓ}∪{[wℓ,vk]:∀kℓ}∪{[vk,vℓ]:k=2,3,ℓ=0,1}..\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} K=\{&[v_k,w_\ell ]:\forall \,k,\ell \}\cup \{[w_\ell ,v_k]:\forall \,k\,\ell \}\\&\cup \{[v_k,v_\ell ]:k=2,3,\ell =0,1\}.. \end{aligned} \end{aligned}$$\end{document}Let E(q,s)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E_{(q,s)}$$\end{document} be a partial RDG with edge probability q as drawn in step (3.A) in Algorithm 1. Defineγ0(q,s):=P[E(q,s)+[v1,v2]=1|E(q,s)∈X],γ1(q,s):=P[E(q,s)+[w1,w2]=1|E(q,s)∈X].\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \gamma _0(q,s)&:=\mathbb {P}[E_{(q,s)}^+[v_1,v_2]=1|E_{(q,s)}\in \mathcal {X}],\\ \gamma _1(q,s)&:=\mathbb {P}[E_{(q,s)}^+[w_1,w_2]=1|E_{(q,s)}\in \mathcal {X}]. \end{aligned} \end{aligned}$$\end{document}To show the claim, it suffices to show that there exist q0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q_0$$\end{document} and s0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s_0$$\end{document} such that γ0(0.5,s0)<γ1(0.5,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(0.5,s_0)<\gamma _1(0.5,s_0)$$\end{document} and γ0(q0,s0)>γ1(q0,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q_0,s_0)>\gamma _1(q_0,s_0)$$\end{document}.
Claim: There exists a s0≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s_0\ge {}2$$\end{document} such that γ0(0.5,s0)<γ1(0.5,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(0.5,s_0)<\gamma _1(0.5,s_0)$$\end{document}.
First, note that by definition γ0(q,s)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q,s)$$\end{document} is independent of the choice of s. Hence there exists γ0(q)∈[0,1]\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q)\in [0,1]$$\end{document} such that γ0(q)=γ0(q,s)for alls≥2.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \gamma _0(q)=\gamma _0(q,s)\quad \text {for all }s\ge {}2. \end{aligned}$$\end{document} In particular by construction γ0(q)≤c\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q)\le {}c$$\end{document} for some c<1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$c<1$$\end{document}. Moreover, by Karp (1990) we have that for a fixed q and s→∞\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s\rightarrow \infty $$\end{document} the number of nodes in the largest component of the random subgraph on V~=w0,w1,⋯,ws\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widetilde{V}=\left\{ {}w_0,w_1,\dots {},w_s\right\} $$\end{document} converges exponentially to s, in particular faster than s-1s\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\nicefrac {s-1}{s}$$\end{document}. Thus, we have that PE[wk,wℓ]=1for allk,ℓ=0,1,⋯,s⟶s→∞1.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \mathbb {P}\left[ {}E[w_k,w_\ell ]=1\text { for all }k,\ell =0,1,\dots {},s\right] \overset{s\rightarrow \infty }{\longrightarrow }1. \end{aligned}$$\end{document} Hence, γ1(q,s)⟶s→∞1,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \gamma _1(q,s)\overset{s\rightarrow \infty }{\longrightarrow }1, \end{aligned}$$\end{document} yielding the existence of an s0≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s_0\ge {}2$$\end{document} such that γ0(0.5,s0)=γ0(0.5)<γ1(0.5,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(0.5,s_0)=\gamma _0(0.5)<\gamma _1(0.5,s_0)$$\end{document}.
Claim: For fixed s≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s\ge {}2$$\end{document} we have for q→0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\rightarrow {}0$$\end{document} that γ0(q,s)→12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q,s)\rightarrow \nicefrac {1}{2}$$\end{document}.
For any s≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s\ge {}2$$\end{document}, q<12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q<\nicefrac {1}{2}$$\end{document} and x,y∈V\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$x,y\in {}V$$\end{document} we compute P[E+[x,y]=1|E(q,s)∈X]=P[E+[x,y]=1andE(q,s)∈X]P[E(q,s)∈X]=∑E0∈Xs.t.E0+[x,y]=1P[E(q,s)=E0]∑E0∈XP[E(q,s)=E0]=∑E0∈Xs.t.E0+[x,y]=1qA(E0)(1-q)B(E0)∑E0∈XqA(E0)(1-q)B(E0)⟶q→0|E0∈X0:E0+[x,y]=1||X0|,\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} \mathbb {P}&[E^+[x,y]=1|E_{(q,s)}\in \mathcal {X}]\\&=\frac{\mathbb {P}[E^+[x,y]=1\text { and }E_{(q,s)}\in \mathcal {X}]}{\mathbb {P}[E_{(q,s)}\in \mathcal {X}]}\\&=\frac{\sum _{E_0\in \mathcal {X}\text { s.t. }E_0^+[x,y]=1}\mathbb {P}[E_{(q,s)}=E_0]}{\sum _{E_0\in \mathcal {X}}\mathbb {P}[E_{(q,s)}=E_0]}\\&=\frac{\sum _{E_0\in \mathcal {X}\text { s.t. }E_0^+[x,y]=1}q^{A(E_0)}(1-q)^{B(E_0)}}{\sum _{E_0\in \mathcal {X}}q^{A(E_0)}(1-q)^{B(E_0)}}\\&\overset{q\rightarrow {}0}{\longrightarrow }\quad {}\frac{|\left\{ {}E_0\in \mathcal {X}_0:E^+_0[x,y]=1\right\} |}{|\mathcal {X}_0|}\,, \end{aligned} \end{aligned}$$\end{document} where X0⊂X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}_0\subset {}\mathcal {X}$$\end{document} is the subset of graphs with minimal edges and A(E0)=|[k,ℓ]:E0[k,ℓ]=1|,B(E0)=|[k,ℓ]:E0[k,ℓ]=0|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \begin{aligned} A(E_0)&=|\left\{ {}[k,\ell ]:E_0[k,\ell ]=1\right\} |,\\ B(E_0)&=|\left\{ {}[k,\ell ]:E_0[k,\ell ]=0\right\} | \end{aligned} \end{aligned}$$\end{document} To satisfy the constraints of the partial observation the graphs with the minimal amount of edges in X\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\mathcal {X}$$\end{document} are given by those that feature an edge E[v3,v2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[v_3,v_2]=1$$\end{document}, that feature either E[v0,v1]=E[v0,v3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[v_0,v_1]=E[v_0,v_3]=1$$\end{document} or E[v0,v1]=E[v1,v3]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[v_0,v_1]=E[v_1,v_3]=1$$\end{document} and that feature a spanning tree rooted in w0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_0$$\end{document} on the subset V~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widetilde{V}$$\end{document}. Thus, we obtain γ0(q0,s)⟶q→012.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \gamma _0(q_0,s)\overset{q\rightarrow {}0}{\longrightarrow }\frac{1}{2}. \end{aligned}$$\end{document}
Claim: For fixed s≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s\ge {}2$$\end{document} there exists a c<12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$c<\nicefrac {1}{2}$$\end{document} such that for q→0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q\rightarrow {}0$$\end{document} we have γ1(q,s)→c\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _1(q,s)\rightarrow {}c$$\end{document}.
Consider that for any spanning tree on V~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widetilde{V}$$\end{document} rooted in w0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_0$$\end{document} that features a path from w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document} to w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document} we can switch the labels of w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document} and w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document} to obtain a spanning tree without a path from w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document} to w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document}. By construction, the above assignment is injective yielding that there are at most as many spanning trees featuring a path from w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document} to w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document} as there are spanning trees who do not feature such a path. Furthermore, consider the spanning tree given by E[w0,wk]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[w_0,w_k]=1$$\end{document} for all k=1,⋯,q\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$k=1,\dots {},q$$\end{document} to obtain that there exist spanning trees that feature neither a path from w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document} to w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document}, nor from w2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_2$$\end{document} to w1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$w_1$$\end{document}. Hence by (A35) and acyclicity of spanning trees there exists a c<12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$c<\nicefrac {1}{2}$$\end{document} such that γ1(q0,s)⟶q→0c.\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\begin{aligned} \gamma _1(q_0,s)\overset{q\rightarrow {}0}{\longrightarrow }c. \end{aligned}$$\end{document}
By Claim 1 we can choose s0≥2\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s_0\ge {}2$$\end{document} such that γ0(0.5,s0)<γ1(0.5,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(0.5,s_0)<\gamma _1(0.5,s_0) $$\end{document}. Given this s0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$s_0$$\end{document}, by Claim 2. and 3. we can choose q0∈(0,1)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$q_0\in (0,1)$$\end{document} small enough such that γ0(q0,s0)>γ1(q0,s0)\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q_0,s_0)>\gamma _1(q_0,s_0)$$\end{document}, finishing the proof.
To adapt the above proof for Algorithm 2 when the RSTs in Step 4.B are drawn uniformly at random consider the following step:
The first claim follows analogously.
Instead of the second claim it can be shown that γ0(q,s)→58\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q,s)\rightarrow \nicefrac {5}{8}$$\end{document} by considering that E+[v1,v2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E^+[v_1,v_2]=1$$\end{document} for 5 of 8 possible spanning trees rooted in v0\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$v_0$$\end{document} (note that E[v3,v2]=1\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$E[v_3,v_2]=1$$\end{document} in any case). Note moreover, that in the case the RSTs are drawn via the modified Broder algorithm as given in Sect. 3.2γ0(q,s)→c<12\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\gamma _0(q,s)\rightarrow {}c<\nicefrac {1}{2}$$\end{document}.
The third claim can be shown to hold also for Algorithm 2 by the analogous arguments. This is true even for the modified version of the Broder algorithm, as it coincides on V~\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\widetilde{V}$$\end{document} with the classical one.
AUC performance for varying sparsity parameter α\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha $$\end{document}. Each experiment was repeated 20 times and all graphs featured p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document} and |I|=200\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|=200$$\end{document}
AUC performance for varying number of known rows |I|\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$|\mathcal {I}|$$\end{document}. Each experiment was repeated 20 times and all graphs featured p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document} and α=0.7\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha =0.7$$\end{document}
AUC performance for the Sachs et al. (2005) data
In Fig. 8 mean ROC curves are displayed for p=25,50,250,500\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=25,50,250, 500$$\end{document} relating to Fig. 3. In Fig. 9 the effect of varying the sparsity parameter α\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha $$\end{document} on the performance of the proposed graph-based predictors is shown for a graph featuring p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document} and #I=200\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\#\mathcal {I}=200$$\end{document}. In Fig. 10 the effect of varying the number of known rows on the performance of the proposed graph-based predictors is shown for a graph featuring p=1000\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p=1000$$\end{document} and α=0.7\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$\alpha =0.7$$\end{document}. Last, in Fig. 11 the AUC performs for all predictors outputting a matrix of scores on the Sachs et al. (2005) proteomics data is reported via box-plots.
Appendix B.2: Computational costs
In Fig. 12a–c the computation times3 for all predictors regarding Figs. 3, 5 and 11 are given, respectively. Note that the computational costs for the IDA (obs) and IDA (int-obs) are basically the same as for PC (obs) and PC (int-obs), respectively, and thus for the ease of presentation the PC results are omitted in (a) and (b). Moreover, in Fig. 12a the computation time of a transitive closure is included as a reference.
Mean computation times for Fig. 3 in panel (a TAP and TAP-q reach the time out at 18,000 s), Fig. 5 in panel (b) and Fig. 11 in panel (c)
The data can be found at https://deleteome.holstegelab.nl/ under the tab Downloads>Causal inference.
The data can be found at https://github.com/yuhaow/sp-intervention.
All computations were run on a HP Z840 workstation.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.