SharePoint Online BCS

I was reading different article about BCS on SharePoint online but I am not sure if what I am planning to do is possibly. Would it be possible to connect my SQL database hosted in Azure to be connected to my SharePoint online so I could show it like an ordinary Lists? I keep reading that the SQL needs to be hosted on-premise but I don't have a server to host it on-premise server. And also I believe it can also connect my SPO to a WCF but not sure if the WCF needs to be on-premise as well or it would work on Azure if hosted correctly. Long story short I just want to show my SQL table to my SharePoint site as a List so less problems for me.

TIA