Reading from custom S3

[guillemc23]

I have some COGs in a Minio bucket, that are served by a STAC API. I managed to read them by setting the following environment variables as explained in https://gdal.org/en/stable/user/virtual_file_systems.html#configuring-vsis3-with-minio:

AWS_VIRTUAL_HOSTING = "FALSE"
AWS_HTTPS="NO"
AWS_S3_ENDPOINT = ""
AWS_REGION=""
AWS_SECRET_ACCESS_KEY=""
AWS_ACCESS_KEY_ID=""

Is there a way to configure a Session or AWSSession that can be injected as an environment_dependency to my TileFactory? Seems like a much more elegant solution but I was not able to make it work when using custom endpoints for my S3 service.

[vincentsarago]

Is there a way to configure a Session or AWSSession that can be injected as an environment_dependency to my TileFactory?

Yes you should be able to do it using environment_dependency 🤷 #999 (comment)

[guillemc23]

This is what I was trying, but I was unable to configure a rasterio.session.AWSSession with a custom endpoint 😬

[guillemc23]

I managed to make this work with the following code:

import os

from rasterio.session import AWSSession

AWS_ACCESS_KEY_ID = os.getenv("AWS_ACCESS_KEY_ID")
AWS_SECRET_ACCESS_KEY = os.getenv("AWS_SECRET_ACCESS_KEY")
AWS_REGION = os.getenv("AWS_REGION")
AWS_S3_ENDPOINT = os.getenv("AWS_S3_ENDPOINT")

session = AWSSession(
    aws_unsigned=False,
    aws_access_key_id=AWS_ACCESS_KEY_ID,
    aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
    region_name=AWS_REGION,
    endpoint_url=AWS_S3_ENDPOINT,
)

def get_session() -> AWSSession:
    """S3 Session getter."""
    return session

def get_env_dependency() -> dict:
    """FastAPI Dependency to retrieve the S3 environment."""
    s3_session = get_session()
    return {"session": s3_session}

######

# Add COG extensions
cog = TilerFactory(
    reader=Reader,
    router_prefix="/cog",
    environment_dependency=get_env_dependency,  # Passes S3 environment
)

with the following environment variables:

AWS_ACCESS_KEY_ID = ""
AWS_SECRET_ACCESS_KEY = ""
AWS_VIRTUAL_HOSTING = "FALSE"
AWS_REGION=""

# Internal IP
# AWS_S3_ENDPOINT = "localhost:1234"
# AWS_HTTPS = "NO"
# Public domain
AWS_S3_ENDPOINT = "s3.example.com"
AWS_HTTPS = "YES"