Meet Fully OpenSource Foundation Model By Salesforce XGen-7B

This model allows long sequences of up to 8K tokens completely free

Salesforce has a reputation for doing good work in the open-source world, including their image encoders models like blip and blip2 (ref: https://huggingface.co/spaces/Salesforce/BLIP2). Now Salesforce has released a small but mighty model that could just fit your needs.