NEWVectors or files. Pick a path.Start →
    cloud

    AWS S3 Integration

    Native S3 bucket synchronization for multimodal ingestion

    Automatically ingest and enrich objects as they land in your S3 buckets. The connector uses S3 Event Notifications to trigger Mixpeek processing on new uploads, keeping your multimodal search index continuously synchronized with your object storage.

    aws
    s3
    object storage
    cloud storage
    event notifications
    ingestion
    Quick Install:
    npm install @mixpeek/aws-s3

    Use Cases

    1

    Auto-indexing media uploads for search

    2

    Continuous enrichment of content delivery pipelines

    3

    Building searchable archives from S3 data lakes

    4

    Synchronizing product images with multimodal catalogs

    Features

    S3 Event Notification triggers for real-time sync
    Prefix and suffix filtering for selective processing
    Automatic content-type detection and routing
    Bulk import for existing bucket contents
    Cross-region replication awareness
    IAM role-based authentication

    Get Started

    Integrations

    AWS S3
    AWS Lambda
    AWS EventBridge
    AWS IAM

    Details

    LicenseApache 2.0
    Categorycloud
    Registrynpm

    Resources

    Documentation

    Learn how to use this connector

    Quick Info

    LicenseApache 2.0
    Categorycloud
    Registrynpm

    Frequently Asked Questions

    How does the AWS S3 Integration sync with Mixpeek?

    The connector configures S3 Event Notifications to send object-created events to an SQS queue or Lambda function. When a new object is uploaded to your bucket, the event triggers Mixpeek processing which extracts features, generates embeddings, and indexes the content for retrieval.

    Can I process only certain file types or prefixes?

    Yes. You can filter events by S3 key prefix (e.g., 'uploads/images/') and suffix (e.g., '.jpg', '.mp4'). This lets you selectively process only the objects you care about and avoid unnecessary API calls on non-content files like logs or config.

    How do I import existing bucket contents?

    The connector includes a bulk import utility that lists all objects in a bucket or prefix and submits them as a batch to Mixpeek. It supports parallel listing for large buckets and checkpointing so you can resume interrupted imports.

    What authentication methods are supported?

    The connector supports IAM role-based authentication (recommended), access key pairs, and instance profiles for EC2/ECS deployments. For cross-account access, it supports IAM role assumption with external IDs.

    Does it work with S3-compatible storage like MinIO?

    Yes. The connector works with any S3-compatible object storage that supports event notifications, including MinIO, LocalStack, and Cloudflare R2. Configure the custom endpoint URL in the connector settings.

    Related connectors

    Google Cloud Storage ConnectorGCS bucket integration for multimodal processingAzure Blob Storage ConnectorAzure storage integration for content intelligenceAWS Lambda TriggerServerless event processing for Mixpeek pipelinesGCP Cloud Functions ConnectorServerless Google Cloud integration for Mixpeek

    Ready to integrate?

    Get started with AWS S3 Integration in minutes. Check out the documentation or explore the source code on GitHub.