[Nuget] update package-lock.json fail when package is in private repository

[McMlok]

How are you running Renovate?

Self-hosted Renovate

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

On-prem K8s

Please tell us more about your question or problem

Hello,

I'm using on-prem renovate in private K8s. When I try to update dependencies in .NET project where is turned on to create package-lock.json, update itself works but update of lock files failed because in my project is reference to packages which are in private Nuget repository. This repository is properly configured and renovate are able to find new versions of packages in it but it looks like that it is not used during dotnet restore command run.

When I tried to attach to container and list configured NuGet repositories I saw only standard nuget.org repo. Also in log I see that restore tries to find package in nuget.org only.

What I'm doing wrong?

Thank you

Logs (if relevant)

Logs

DEBUG: Executing command (repository=MyRepo, baseBranch=master, branch=feature/renovate/master-dependencies-non-major)
       "command": "dotnet restore MyProject.csproj --force-evaluate --configfile /tmp/renovate/cache/__renovate-private-cache/nuget/nuget.config"
DEBUG: rawExec err (repository=MyRepo, baseBranch=master, branch=feature/renovate/master-dependencies-non-major)
       "err": {
         "cmd": "/bin/sh -c dotnet restore MyProject.csproj --force-evaluate --configfile /tmp/renovate/cache/__renovate-private-cache/nuget/nuget.config",
         "stderr": "",
         "stdout": "Determining projects to restore...\n  Restored /tmp/renovate/repos/bitbucket-server/MyRepo/MyProject.csproj (in 8.16 sec).\n/tmp/renovate/repos/bitbucket-server/MyRepo/MyProject.csproj : error NU1101: Unable to find package MyDependency. No packages exist with this id in source(s): nuget.org  
         "options": {
           "cwd": "/tmp/renovate/repos/bitbucket-server/MyRepo",
           "encoding": "utf-8",
           "env": {
             "NUGET_PACKAGES": "/tmp/renovate/cache/__renovate-private-cache/nuget/packages",
             "MSBUILDDISABLENODEREUSE": "1",
             "HOME": "/home/ubuntu",
             "PATH": "/home/ubuntu/.local/bin:/home/ubuntu/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/home/ubuntu/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
             "LC_ALL": "C.UTF-8",
             "LANG": "C.UTF-8",
             "RENOVATE_USERNAME": "**redacted**",
             "RENOVATE_PASSWORD": "**redacted**"
           },
           "maxBuffer": 10485760,
           "timeout": 900000
         },
         "exitCode": 1,
         "name": "ExecError",
         "message": "Command failed: dotnet restore MyProject.csproj --force-evaluate --configfile /tmp/renovate/cache/__renovate-private-cache/nuget/nuget.config\n",
         "stack": "ExecError: Command failed: dotnet restore MyProject.csproj --force-evaluate --configfile /tmp/renovate/cache/__renovate-private-cache/nuget/nuget.config\n\n    at ChildProcess.<anonymous> (/usr/local/renovate/lib/util/exec/common.ts:119:11)\n    at ChildProcess.emit (node:events:530:35)\n    at ChildProcess.emit (node:domain:489:12)\n    at Process.ChildProcess._handle.onexit (node:internal/child_process:293:12)"
       },
       "durationMs": 21958

[McMlok]

I forgot to add I'm using image with tag 39.179-full.

I also tried to add private repository to default Nuget.config file but it did not help. It looks like that renovate create its own config file and use it.

[rarkins]

Does Renovate itself look up dependencies from the right registries, including private? If so, how do you know?

[McMlok]

Yes, when I turn off generating lock files and run renovate on the same project, I get PR with updated versions from a private nuget feed on references which are only in private feed. If I understand the log, Renovate create, before it calls dotnet restore, special Nuget.config file but I'm not able to get the content to check if there is the private feed or not.

[rarkins]

Unfortunately it's hard for us to guess the problem from afar, without access to your config and runtime.

The logic for creating a Nuget.config exists here: https://github.com/renovatebot/renovate/blob/main/lib/modules/manager/nuget/config-formatter.ts#L13

Something you could try is killing the Renovate process while it's running dotnet restore. Then you should be able to retrieve the Nuget.config which was created and written to disk prior to that command.

[McMlok]

Understood, the code looks OK. I will try to kill renovate a inspect the file. Thank you

[McMlok]

OK I looked to the file and it contains only standard nuget.org

cat /tmp/renovate/cache/__renovate-private-cache/nuget/nuget.config

<?xml version="1.0" encoding="utf-8"?>
<configuration>
<packageSources>
<add key="nuget.org" value="https://api.nuget.org/v3/index.json" protocolVersion="3" />
</packageSources>
</configuration>

[McMlok]

OK, I read the code for nuget and maybe I have wrong configuration for custom Nuget DataSource. I'm using configuration with

....
"packageRules": [
        {
          "matchDatasources": ["nuget"],
          "registryUrls": [
            "https://nexus3.kb.cz/repository/nuget-all-v3/index.json"
          ]
        }
]
..

In code the restore it calls createCachedNuGetConfigFile where are defined registries for created Nuget.config. It calls getConfiguredRegistries where it tries to fing nuget.config file and read registries from there. But because I don't see in my log a line with message 'Found NuGet.config at' it uses result of getDefaultRegistries method and there is only hardcoded nuget.org registry.

What is the correct way how to configure custom Nuget registry in config.json file? I haven't a nuget.config file in my projects and I want to globally add custom registry to renovate container.

Thank you.

[github-actions[bot]]

Hi there,

The logs you provided are insufficient to help you.

Please provide more logs, or more detailed logs, so we can help you. Be sure to include DEBUG logs, and don't excessively redact or truncate them.

If you feel the logs are too large to paste here, please use a service like GitHub Gist and paste the link here.

Read the Renovate docs, Troubleshooting to learn more about getting the correct logs.

Thanks, the Renovate team