Huawei OBS File
The following code demonstrates how to load an object from the Huawei OBS (Object Storage Service) as document.
# Install the required package
# pip install esdk-obs-python
from langchain_community.document_loaders.obs_file import OBSFileLoader
API Reference:OBSFileLoader
endpoint = "your-endpoint"
from obs import ObsClient
obs_client = ObsClient(
access_key_id="your-access-key",
secret_access_key="your-secret-key",
server=endpoint,
)
loader = OBSFileLoader("your-bucket-name", "your-object-key", client=obs_client)
loader.load()
Each Loader with Separate Authentication Information
If you don't need to reuse OBS connections between different loaders, you can directly configure the config
. The loader will use the config information to initialize its own OBS client.
# Configure your access credentials\n
config = {"ak": "your-access-key", "sk": "your-secret-key"}
loader = OBSFileLoader(
"your-bucket-name", "your-object-key", endpoint=endpoint, config=config
)
loader.load()
Get Authentication Information from ECS
If your langchain is deployed on Huawei Cloud ECS and Agency is set up, the loader can directly get the security token from ECS without needing access key and secret key.
config = {"get_token_from_ecs": True}
loader = OBSFileLoader(
"your-bucket-name", "your-object-key", endpoint=endpoint, config=config
)
loader.load()
Access a Publicly Accessible Object
If the object you want to access allows anonymous user access (anonymous users have GetObject
permission), you can directly load the object without configuring the config
parameter.
loader = OBSFileLoader("your-bucket-name", "your-object-key", endpoint=endpoint)
loader.load()
Related
- Document loader conceptual guide
- Document loader how-to guides