nofiles match the configured criteria - Kubernetes logs collection issue

[genseb13011]

Hi,

I'm trying to collect my kubernetes pods logs and I'm facing an issue with my filelog receivers.

The issue i'm facing is that no logs are sent to logs backend (Grafana Labs)

I can see below warn in the opentelemetry pods (Daemonset)

2024-06-20T10:46:40.038Z warn fileconsumer/file.go:51 finding files {"kind": "receiver", "name": "filelog", "data_type": "logs", "component": "fileconsumer", "error": "nofiles match the configured criteria"}

Thanks for your help.

Other technical information:

• Opentelemetry Operator image version: 0.102.0
• Opentelemetry Operator helm chart version:
• An opentelemetry Deployment to collect metrics works well
• Kubernetes version: 1.28
• Content of my OpenTelemetryCollector resource: 0.62.0

apiVersion: opentelemetry.io/v1beta1
kind: OpenTelemetryCollector
metadata:
  name: opentelemetry-daemonset
spec:
  mode: daemonset
  config:
    extensions:
      basicauth/otlp:
        client_auth:
          username: ***************
          password: ****************
    receivers:
      filelog:
        include:
          - /var/log/pods/*/*/*.log
        include_file_name: false
        include_file_path: true
        start_at: beginning
        operators:
          - id: get-format
            routes:
              - expr: body matches "^\\{"
                output: parser-docker
              - expr: body matches "^[^ Z]+ "
                output: parser-crio
              - expr: body matches "^[^ Z]+Z"
                output: parser-containerd
            type: router
          - id: parser-crio
            output: extract_metadata_from_filepath
            regex: ^(?P<time>[^ Z]+) (?P<stream>stdout|stderr) (?P<logtag>[^ ]*) ?(?P<log>.*)$
            timestamp:
              layout: 2006-01-02T15:04:05.999999999Z07:00
              layout_type: gotime
              parse_from: attributes.time
            type: regex_parser
          - id: parser-containerd
            output: extract_metadata_from_filepath
            regex: ^(?P<time>[^ ^Z]+Z) (?P<stream>stdout|stderr) (?P<logtag>[^ ]*) ?(?P<log>.*)$
            timestamp:
              layout: '%Y-%m-%dT%H:%M:%S.%LZ'
              parse_from: attributes.time
            type: regex_parser
          - id: parser-docker
            output: extract_metadata_from_filepath
            timestamp:
              layout: '%Y-%m-%dT%H:%M:%S.%LZ'
              parse_from: attributes.time
            type: json_parser
          - id: extract_metadata_from_filepath
            parse_from: attributes["log.file.path"]
            regex: ^.*\/(?P<namespace>[^_]+)_(?P<pod_name>[^_]+)_(?P<uid>[a-f0-9\-]+)\/(?P<container_name>[^\._]+)\/(?P<restart_count>\d+)\.log$
            type: regex_parser
          - from: attributes.stream
            to: attributes["log.iostream"]
            type: move
          - from: attributes.container_name
            to: resource["k8s.container.name"]
            type: move
          - from: attributes.namespace
            to: resource["k8s.namespace.name"]
            type: move
          - from: attributes.pod_name
            to: resource["k8s.pod.name"]
            type: move
          - from: attributes.restart_count
            to: resource["k8s.container.restart_count"]
            type: move
          - from: attributes.uid
            to: resource["k8s.pod.uid"]
            type: move
          - from: attributes.log
            to: body
            type: move

    exporters:
      otlphttp:
        auth:
          authenticator: basicauth/otlp
        endpoint: *******************
      debug:
        verbosity: detailed

    service:
      extensions: 
        - basicauth/otlp
      pipelines:
        logs:
          receivers: [filelog]
          processors: []
          exporters: [otlphttp]