Ontario does allow for non residents to open both Ltd/Inc. companies and LP's. You can even do so online if you open a MyOntario account -
https://signin.ontario.ca/. I'm sort of in a similar sitaution: EU Resident and I do some International Import/Export/Commodity trading. I have one company in my country of residence (France) and I have an LP in Ontario. I do hold dual citzenship with Canada, but I am not at all tax resident there and have not been for more than 20 years.
Banking was a bit tricky - but I am regularly travelling back and forth to Canada every few months, so on one of my trips I opened a bank account in person at a branch. Other than this, setting up an LP as a non-resident (foreigner or citizen) is pretty easy to do and I think it's like $300 CAD for like a 5 year license or something. In my case I set up the General Partner of my LP as my French LLC (an SAS in French). I did NOT need to register this SAS as an EPC as the SAS is sort of like a US LLC and these are not company structures with equivalences in Ontario. So I just declared my French SAS as the GP with an Extra-Provincial LLC declaration form - it is different from the EPC form.
You will get a BIN number when you register in Ontario, and this serves as your LP Identifier.