What s the proper way to go get a private repository

Question

I m searching for the way to get   go get work with private repository  after many google try     The first try     go get -v gitlab com secmask awserver-go Fetching https   gitlab com secmask awserver-go go-get 1 https fetch failed  Fetching http   gitlab com secmask awserver-go go-get 1 Parsing meta tags from http   gitlab com secmask awserver-go go-get 1  status code 200  import  gitlab com secmask awserver-go   parse http   gitlab com secmask awserver-go go-get 1  no go-import meta tags package gitlab com secmask awserver-go  unrecognized import path  gitlab com secmask awserver-go   Yep  it did not see the meta tags because I could not know how to provide login information   The second try   Follow https   gist github com shurcooL 6927554  Add config to  gitconfig    url  ssh   git gitlab com        insteadOf   https   gitlab com    go get -v gitlab com secmask awserver-go -- gt  not work   go get -v gitlab com secmask awserver-go git -- gt  work but I got src gitlab com secmask awserer-go git   Yes it work but with  git extension with my project name  I can rename it to original but do it everytime   go get is not so good  is there an otherway

User · Answer

The proper way is to manually put the repository in the right place. Once the repository is there, you can use go get -u to update the package and go install to install it. A package named

github.com/secmask/awserver-go

goes into

$GOPATH/src/github.com/secmask/awserver-go

The commands you type are:

cd $GOPATH/src/github.com/secmask
git clone [email protected]:secmask/awserver-go.git

User · Answer

I have created a user specific ssh-config  so my user automatically logs in with the correct credentials and key   First I needed to generate an key-pair  ssh-keygen -t rsa -b 4096 -C  my email here    and saved it to e g    ssh id my domain  Note that this is also the keypair  private and public  I ve connected to my Github account  so mine is stored in   ssh id github com   I have then created  or altered  a file called    ssh config with an entry   Host github com     HostName github com     User git     IdentityFile    ssh id github com   On another server  the  ssh-url  is admin domain com username private-repo git and the entry for this server would have been   Host domain com     HostName domain com     User admin     IdentityFile    ssh id domain com   Just to clarify that you need ensure that the User  Host and HostName is set correctly   Now I can just browse into the go path and then go get  lt package gt   e g go get main where the file main main go includes the package  from last example above  domain com username private-repo git

User · Answer

If you ve already got git using SSH  this answer by Ammar Bandukwala is a simple workaround       go get uses git internally  The following one liners will make git and consequently   go get clone your package via SSH   Github     git config --global url  git github com   insteadOf  https   github com     BitBucket     git config --global url  git bitbucket org   insteadOf  https   bitbucket org

User · Answer

Generate a github oauth token here and export your github token as an environment variable   export GITHUB TOKEN 123   Set git config to use the basic auth url   git config --global url  https    GITHUB TOKEN x-oauth-basic github com   insteadOf  https   github com     Now you can go get your private repo

User · Answer

That looks like the GitLab issue 5769   In GitLab  since the repositories always end in  git  I must specify  git at the end of the repository name to make it work  for example  import  quot example org myuser mygorepo git quot   And    go get example org myuser mygorepo git  Looks like GitHub solves this by appending  quot  git quot    It is supposed to be resolved in    Added support for Go s repository retrieval   5958     provided the right meta tags are in place  Although there is still an issue for Go itself     cmd go  go get cannot discover meta tag in HTML5 documents

User · Answer

For me  the solutions offered by others still gave the following error during go get     git gl nimi24 com  Permission denied  publickey      fatal  Could not read from remote repository     Please make sure you have the correct access rights    and the repository exists    What this solution required   As stated by others   git config --global url  git github com   insteadOf  https   github com   Removing the passphrase from my   ssh id rsa key which was used for authenticating the connection to the repository  This can be done by entering an empty password when prompted as a response to   ssh-keygen -p   Why this works  This is not a pretty workaround as it is always better to have a passphrase on your private key  but it was causing issues somewhere inside OpenSSH    go get uses internally git  which uses openssh to open the connection  OpenSSH takes the certs necessary for authentication from  ssh id rsa  When executing git commands from the command line an agent can take care of opening the id rsa file for you so that you do not have to specify the passphrase every time  but when executed in the belly of go get  this did not work somewhy in my case  OpenSSH wants to prompt you then for a password but since it is not possible due to how it was called  it prints to its debug log      read passphrase  can t open  dev tty  No such device or address   And just fails  If you remove the passphrase from the key file  OpenSSH will get to your key without that prompt and it works  This might be caused by Go fetching modules concurrently and opening multiple SSH connections to Github at the same time  as described in this article   This is somewhat supported by the fact that OpenSSH debug log showed the initial connection to the repository succeed  but later tried it again for some reason and this time opted to ask for a passphrase    However the solution of using SSH connection multiplexing as put forward in the mentioned article did not work for me  For the record  the author suggested adding the collowing conf to the ssh config file for the affected host     ControlMaster auto   ControlPersist 3600   ControlPath    ssh  r  h  p   But as stated  for me it did not work  maybe I did it wrong

User · Answer

I ve written up a long answer to this question  but it covers repositories that are accessed via ssh key access  not https with meta tags   It covers both packages and modules   It also mentions how to use branches other than master  Post a comment or response if I ve missed anything

User · Answer

You have one thing to configure  The example is based on GitHub but this shouldn t change the process    git config --global url git github com  insteadOf https   github com    cat    gitconfig  url  quot git github com  quot       insteadOf   https   github com    go get github com private repo  For Go modules to work  with Go 1 11 or newer   you ll also need to set the GOPRIVATE variable  to avoid using the public servers to fetch the code  export GOPRIVATE github com private repo

User · Answer

After setting up GOPRIVATE and git config     People may still meeting problems like this when fetching private source  https fetch  Get  quot https   private user repo go-get 1 quot   EOF  They can t use private repo without  git extension  The reason is the go tool has no idea about the VCS protocol of this repo  git or svn or any other  unlike github com or golang org them are hardcoded into go s source  Then the go tool will do a https query before fetching your private repo  https   private user repo go-get 1  If your private repo has no support for https request  please use replace to tell it directly   require private user repo v1 0 0       replace private user repo   gt  private server user repo git v1 0 0  https   golang org cmd go  hdr-Remote import paths

User · Answer

I came across  netrc and found it relevant to this  Create a file    netrc with the following content  machine github com     login  lt github username gt      password  lt github password or Personal access tokens  gt   Done  Additionally  for latest GO versions  you might need to add this to the environment variables GOPRIVATE github com  I ve added it to my  zshrc  netrc also makes my development environment setup better as my personal github access for HTTPS is been configured now to be used across the machine  just like my SSH configuration   Generate GitHub personal access tokens  https   github com settings tokens See this answer for its use with Git on Windows specifically Ref  netrc man page  If you want to stick with the SSH authentication  then mask the request to use ssh forcefully git config --global url  quot git github com  quot  insteadOf  quot https   github com  quot   More methods for setting up git access  https   gist github com technoweenie 1072829 gistcomment-2979908

User · Answer

All of the above did not work for me  Cloning the repo was working correctly but I was still getting an unrecognized import error   As it stands for Go v1 13  I found in the doc that we should use the GOPRIVATE env variable like so     GOPRIVATE github com ORGANISATION OR USER NAME go get -u github com ORGANISATION OR USER NAME REPO NAME

User · Answer

For people using private GitLabs  here s a snippet that may help  https   gist github com MicahParks 1ba2b19c39d1e5fccc3e892837b10e21 Also pasted below  Problem The go command line tool needs to be able to fetch dependencies from your private GitLab  but authenticaiton is required  This assumes your private GitLab is hosted at privategitlab company com  Environment variables The following environment variables are recommended  export GO111MODULE on export GOPRIVATE privategitlab company com  The above lines might fit best in your shell startup  like a    bashrc  Explanation GO111MODULE on tells Golang command line tools you are using modules  I have not tested this with projects not using Golang modules on a private GitLab  GOPRIVATE privategitlab company com tells Golang command line tools to not use public internet resources for the hostnames listed  like the public module proxy   Get a personal access token from your private GitLab To future proof these instructions  please follow this guide from the GitLab docs  I know that the read api scope is required for Golang command line tools to work  and I may suspect read repository as well  but have not confirmed this  Set up the    netrc In order for the Golang command line tools to authenticate to GitLab  a    netrc file is best to use  To create the file if it does not exist  run the following commands  touch    netrc chmod 600    netrc  Now edit the contents of the file to match the following  machine privategitlab company com login USERNAME HERE password TOKEN HERE  Where USERNAME HERE is replaced with your GitLab username and TOKEN HERE is replaced with the access token aquired in the previous section  Common mistakes Do not set up a global git configuration with something along the lines of this  git config --global url  quot git privategitlab company com  quot  insteadOf  quot https   privategitlab company com quot   I beleive at the time of writing this  the SSH git is not fully supported by Golang command line tools and this may cause conflicts with the    netrc  Bonus  SSH config file For regular use of the git tool  not the Golang command line tools  it s convient to have a    ssh config file set up  In order to do this  run the following commands  mkdir    ssh chmod 700    ssh touch    ssh config chmod 600    ssh config  Please note the permissions on the files and directory above are essentail for SSH to work in it s default configuration on most Linux systems  Then  edit the    ssh config file to match the following  Host privategitlab company com   Hostname privategitlab company com   User USERNAME HERE   IdentityFile    ssh id rsa  Please note the spacing in the above file matters and will invalidate the file if it is incorrect  Where USERNAME HERE is your GitLab username and    ssh id rsa is the path to your SSH private key in your file system  You ve already uploaded its public key to GitLab  Here are some instructions

User · Answer

I had a problem with go get using private repository on gitlab from our company  I lost a few minutes trying to find a solution  And I did find this one    You need to get a private token at  https   gitlab mycompany com profile account Configure you git to add extra header with your private token     git config --global http extraheader  PRIVATE-TOKEN  YOUR PRIVATE TOKEN  Configure your git to convert requests from http to ssh     git config --global url  git gitlab mycompany com   insteadOf  https   gitlab mycompany com    Finally you can use your go get normally     go get gitlab com company private repo

[git] What's the proper way to "go get" a private repository?

Examples related to git

Examples related to go