Skip to content

add support for protobuf encoding#35

Merged
rrutum merged 5 commits intodream-horizon-org:masterfrom
darshanime-d11:proto
Jan 12, 2026
Merged

add support for protobuf encoding#35
rrutum merged 5 commits intodream-horizon-org:masterfrom
darshanime-d11:proto

Conversation

@darshanime-d11
Copy link
Copy Markdown
Contributor

@darshanime-d11 darshanime-d11 commented Dec 16, 2025

this PR adds support to encode message in protobuf encoding, for use with the kafka sink.

the samples/pluto.dg file has been updated to use the protobuf serialiser.

{
    "clear_data": true,
    "models": [
        {
            "model_name": "pluto",
            "target_sinks": [
                "pluto_kafka"
            ],
            "count": 100
        }
    ],
    "sinks": [
        {
            "sink_name": "pluto_kafka",
            "sink_type": "kafka",
            "config": {
                "topic": "pluto-events",
                "key": "age",
                "include_key_in_message": "true",
                "bootstrap_servers": [
                    "localhost:9092"
                ],
                "throttle": "1ms",
                "batch_size": 100
            }
        }
    ]
}
$ datagen execute ./samples -c ./samples/config.json

Copy link
Copy Markdown

@orca-security-in orca-security-in Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Orca Security Scan Summary

Status Check Issues by priority
Passed Passed Infrastructure as Code high 0   medium 4   low 12   info 7 View in Orca
Passed Passed SAST high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Secrets high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Vulnerabilities high 0   medium 0   low 0   info 0 View in Orca
🛡️ The following IaC misconfigurations have been detected
NAME FILE
medium Controller creating containers without dropped capabilities docker-compose.yml View in code
medium Controller creating containers without dropped capabilities docker-compose.yml View in code
medium Controller creating containers without dropped capabilities docker-compose.yml View in code
medium Controller creating containers without dropped capabilities docker-compose.yml View in code
low CPU Limits Not Set docker-compose.yml View in code
low CPU Limits Not Set docker-compose.yml View in code
low CPU Limits Not Set docker-compose.yml View in code
low CPU Limits Not Set docker-compose.yml View in code
low Container Memory Limits Not Defined docker-compose.yml View in code
low Container Memory Limits Not Defined docker-compose.yml View in code
low Container Memory Limits Not Defined docker-compose.yml View in code
low Container Memory Limits Not Defined docker-compose.yml View in code
low Container Traffic Not Bound to Host Interface docker-compose.yml View in code
low Container Traffic Not Bound to Host Interface docker-compose.yml View in code
low Container Traffic Not Bound to Host Interface docker-compose.yml View in code
low Container Traffic Not Bound to Host Interface docker-compose.yml View in code
info Container Healthcheck Not Defined docker-compose.yml View in code
info Container Healthcheck Not Defined docker-compose.yml View in code
info Docker Compose Volumes Shared Between Containers docker-compose.yml View in code
info Ensure that, if applicable, SELinux security options are set (Automated) docker-compose.yml View in code
info Ensure that, if applicable, SELinux security options are set (Automated) docker-compose.yml View in code
info Ensure that, if applicable, SELinux security options are set (Automated) docker-compose.yml View in code
info Ensure that, if applicable, SELinux security options are set (Automated) docker-compose.yml View in code

@darshanime-d11 darshanime-d11 force-pushed the proto branch 2 times, most recently from 857a4c6 to 4a98c48 Compare December 18, 2025 06:57
@darshanime-d11 darshanime-d11 marked this pull request as ready for review December 18, 2025 06:58
Copy link
Copy Markdown

@orca-security-in orca-security-in Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Orca Security Scan Summary

Status Check Issues by priority
Passed Passed Infrastructure as Code high 0   medium 0   low 0   info 0 View in Orca
Passed Passed SAST high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Secrets high 0   medium 0   low 0   info 0 View in Orca
Passed Passed Vulnerabilities high 0   medium 0   low 0   info 0 View in Orca

Comment thread runner/testdata/transpiledTestFiles/with_metadata.go
@rrutum rrutum merged commit dc5e70d into dream-horizon-org:master Jan 12, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants