Lecture 18 Code

Binary Simulation

Let $Y_i\stackrel{iid}{\sim }Bernoulli(p_i)$ with $p_i=g^{-1}({\mathit{X}}_i^{\mathrm{T}}\mathit{\beta })$

1logit <- \(x){log(x/(1-x))}
2inv_logit <- \(x){exp(x)/(1+exp(x))}

3x <- rnorm(1000, 1)

4eta <- 3 - 8 * x

5y <- sapply(eta, \(x) rbinom(1, 1, inv_logit(x)))

1

Creating logit function

2

Creating inverse logit function

3

Simulating predictors from $N(2,1)$

4

Constructing linear model

5

Simulating outcome

Binary Model

Using $g(\mu )=\log (\frac{\mu }{1-\mu })$ and $f(y)=p^y(1-p{)}^{1-y}$, find the maximum likelihood estimates for the simulated data from the previous slide using the optim function.

$$\ell (\mathit{\beta })=\sum _{i=1}^n{y}_i\log (p_i)+(1-y_i)\log (1-p_i)$$

• $p_i=g^{-1}({\mathit{X}}^{\mathrm{T}}\mathit{\beta })$

Code

1llb <- \(x, y, beta){
2  eta <- beta[1] + beta[2] * x
3  p <- inv_logit(eta)
4  ll <- y * log(p) + (1 - y) * log(1 - p)
5  return(-sum(ll))
}

6optim(c(0,0), llb, x = x, y = y)

1

Creating a function called llb for log-likelihood

2

Constructing linear model

3

Obtaining inverse logit value for linear model

4

Obtaining individual log-likelihood values

5

Returning log-likelihood value based of the sum for all observation, returning a negative value for optim

6

Using optim to find the values for $\hat{\mathit{\beta }}$

$par
[1]  2.697667 -7.624155

$value
[1] 137.0459

$counts
function gradient 
      67       NA 

$convergence
[1] 0

$message
NULL