Webclient HttpWebRequest with Basic Authentication returns 404 not found for valid URL

Question

Edit  I wanted to come back to note that the problem wasn t on my end at all  but rather with with code on the other company s side   I m trying to pull up a page using Basic Authentication  I keep getting a 404 Page not found error  I can copy and paste my url into the browser and it works fine  if I m not logged into their site already it pops up a credential box  otherwise it opens what I want it to open   I must be getting to the right place and authenticating  because I get a 401  not authenticated error  if I intentially put in a bad username password and I get an internal server error 500 if I pass it a bad parameter in the query string  I ve tried using Webclient and HttpWebRequest both leading to the same 404 not found error    With Webclient   string url    MyValidURLwithQueryString   WebClient client   new WebClient    String userName    myusername   String passWord    mypassword   string credentials   Convert ToBase64String Encoding ASCII GetBytes userName         passWord    client Headers HttpRequestHeader Authorization     Basic     credentials  var result   client DownloadString url   Response Write result     With HttpWebRequest  HttpWebRequest request    HttpWebRequest WebRequest Create  MyValidURL    string authInfo    username password   authInfo   Convert ToBase64String Encoding Default GetBytes authInfo    request Headers Add  Authorization    Basic     authInfo   request Credentials   new NetworkCredential  username    password    request Method   WebRequestMethods Http Get  request AllowAutoRedirect   true  request Proxy   null  HttpWebResponse response    HttpWebResponse request GetResponse    Stream stream   response GetResponseStream    StreamReader streamreader   new StreamReader stream   string s   streamreader ReadToEnd    Response Write s

User · Answer

BEWARE   This works ONLY if the server returns 401 first   The client DOES NOT send credentials on first request   ONLY after a 401 client Credentials   new NetworkCredential userName  passWord     doesnt work    So use THIS instead to send credentials RIGHT AWAY string credentials   Convert ToBase64String      Encoding ASCII GetBytes userName         password    client Headers HttpRequestHeader Authorization    string Format       Basic  0    credentials

User · Answer

This part of code worked fine for me           WebRequest request   WebRequest Create url           request Method   WebRequestMethods Http Get          NetworkCredential networkCredential   new NetworkCredential logon  password      logon in format  domain username          CredentialCache myCredentialCache   new CredentialCache   new Uri url    Basic   networkCredential            request PreAuthenticate   true          request Credentials   myCredentialCache          using  WebResponse response   request GetResponse                          Console WriteLine   HttpWebResponse response  StatusDescription                using  Stream dataStream   response GetResponseStream                                  using  StreamReader reader   new StreamReader dataStream                                         string responseFromServer   reader ReadToEnd                        Console WriteLine responseFromServer

User · Answer

Try changing the Web Client request authentication part to   NetworkCredential myCreds   new NetworkCredential userName  passWord   client Credentials   myCreds    Then make your call  seems to work fine for me

User · Answer

If its working when you are using a browser and then passing on your username and password for the first time - then this means that once authentication is done Request header of your browser is set with required authentication values  which is then passed on each time a request is made to hosting server    So start with inspecting Request Header  this could be done using Web Developers tools   Once you established whats required in header then you could pass this within your HttpWebRequest Header    Example with Digest Authentication    using System  using System Collections Generic  using System Linq  using System Text  using System Security Cryptography  using System Text RegularExpressions  using System Net  using System IO   namespace NUI       public class DigestAuthFixer               private static string  host          private static string  user          private static string  password          private static string  realm          private static string  nonce          private static string  qop          private static string  cnonce          private static DateTime  cnonceDate          private static int  nc   public DigestAuthFixer string host  string user  string password           TODO  Complete member initialization      host   host       user   user       password   password     private string CalculateMd5Hash      string input        var inputBytes   Encoding ASCII GetBytes input       var hash   MD5 Create   ComputeHash inputBytes       var sb   new StringBuilder        foreach  var b in hash          sb Append b ToString  x2         return sb ToString       private string GrabHeaderVar      string varName      string header        var regHeader   new Regex string Format    0                 varName        var matchHeader   regHeader Match header       if  matchHeader Success          return matchHeader Groups 1  Value      throw new ApplicationException string Format  Header  0  not found   varName       private string GetDigestHeader      string dir         nc    nc   1       var ha1   CalculateMd5Hash string Format   0   1   2     user   realm   password        var ha2   CalculateMd5Hash string Format   0   1     GET   dir        var digestResponse           CalculateMd5Hash string Format   0   1   2 00000000   3   4   5    ha1   nonce   nc   cnonce   qop  ha2         return string Format  Digest username    0     realm    1     nonce    2     uri    3                  algorithm MD5  response    4     qop  5   nc  6 00000000   cnonce    7               user   realm   nonce  dir  digestResponse   qop   nc   cnonce      public string GrabResponse      string dir        var url    host   dir      var uri   new Uri url        var request    HttpWebRequest WebRequest Create uri           If we ve got a recent Auth header  re-use it      if   string IsNullOrEmpty  cnonce   amp  amp          DateTime Now Subtract  cnonceDate  TotalHours  lt  1 0                request Headers Add  Authorization   GetDigestHeader dir               HttpWebResponse response      try               response    HttpWebResponse request GetResponse              catch  WebException ex                   Try to fix a 401 exception by adding a Authorization header         if  ex Response    null      HttpWebResponse ex Response  StatusCode    HttpStatusCode Unauthorized              throw           var wwwAuthenticateHeader   ex Response Headers  WWW-Authenticate             realm   GrabHeaderVar  realm   wwwAuthenticateHeader            nonce   GrabHeaderVar  nonce   wwwAuthenticateHeader            qop   GrabHeaderVar  qop   wwwAuthenticateHeader             nc   0           cnonce   new Random   Next 123400  9999999  ToString             cnonceDate   DateTime Now           var request2    HttpWebRequest WebRequest Create uri           request2 Headers Add  Authorization   GetDigestHeader dir            response    HttpWebResponse request2 GetResponse              var reader   new StreamReader response GetResponseStream         return reader ReadToEnd           Then you could call it   DigestAuthFixer digest   new DigestAuthFixer domain  username  password   string strReturn   digest GrabResponse dir     if Url is  http   xyz rss com folder rss then domain  http   xyz rss com  domain part  dir   folder rss  rest of the url   you could also return it as stream and use XmlDocument Load   method

[c#] Webclient / HttpWebRequest with Basic Authentication returns 404 not found for valid URL

Examples related to c#

Examples related to .net