So for the context, the brothers are very close and inseparable since they were kids. Although joe gets super annoyed by his incompetent younger brothers (especially averell) he actually cares for them.. either it's a genuine feeling to protect his brothers or bcs of parentification since he's the oldest