Healthchecks fail when using ALB routing via hostname

I have two services using two ALBs. In order to cut costs, I would like to use the same ALB to fan out to different target groups where my applications are registered. The problem is that once I configure the routing and attach the target group to the rule, my applications cannot register in the target group since they start failing the healthchecks. Am I missing something here?