使用Google Drive API将文件上传到Google云端硬盘时出现OutOfMemoryException

Question

这是一个Web应用程序。我正在使用GoogleDrive API将大文件上传到Google云端硬盘。我的代码适用于较小的文件。但是，当涉及到更大的文件错误发生。

我有很多搜索，但找不到工作解决方案和一些没有答案的问题。

错误发生在文件转换为byte []的代码部分。

byte[] fileData = System.IO.File.ReadAllBytes(dir); 

对于的web.config我曾试图改变请求长度，但它不是一个大的文件。

<httpRuntime targetFramework="4.5" executionTimeout="520000" maxRequestLength="920000" /> 

任何人都有解决方案吗？提前致谢！

以下是完整的代码。

---

using System; 
using System.Diagnostics; 
using DotNetOpenAuth.OAuth2; 
using Google.Apis.Authentication.OAuth2; 
using Google.Apis.Authentication.OAuth2.DotNetOpenAuth; 
using Google.Apis.Drive.v2; 
using Google.Apis.Drive.v2.Data; 
using Google.Apis.Util; 
using ASPSnippets.GoogleAPI; 
using System.Web.Script.Serialization; 
using System.Web; 
using System.Collections.Generic; 
using System.Net.Http; 
using System.Net; 
using System.IO; 
using System.Reflection; 

namespace GoogleDriveAutoUpdate 
{ 
    public partial class GoogleDriveSample : System.Web.UI.Page 
    { 
     static int flagUpdateFile; 
     protected string[] dirs = Directory.GetFiles(@"C:\Users\RNKP74\Desktop\GoogleDrive"); 


     protected void Page_Load(object sender, EventArgs e) 
     { 
      GoogleConnect.ClientId = ""; 
      GoogleConnect.ClientSecret = ""; 
      GoogleConnect.RedirectUri = Request.Url.AbsoluteUri.Split('?')[0]; 
      GoogleConnect.API = EnumAPI.Drive; 

      if (string.IsNullOrEmpty(Request.QueryString["code"])) 
       GoogleConnect.Authorize("https://www.googleapis.com/auth/drive.file"); 

      if (flagUpdateFile == 0) 
       UploadFile(); 
     } 

     protected HttpPostedFile ConstructHttpPostedFile(byte[] data, string filename, string contentType = null) 
     { 
      // Get the System.Web assembly reference 
      Assembly systemWebAssembly = typeof(HttpPostedFileBase).Assembly; 
      // Get the types of the two internal types we need 
      Type typeHttpRawUploadedContent = systemWebAssembly.GetType("System.Web.HttpRawUploadedContent"); 
      Type typeHttpInputStream = systemWebAssembly.GetType("System.Web.HttpInputStream"); 

      // Prepare the signatures of the constructors we want. 
      Type[] uploadedParams = { typeof(int), typeof(int) }; 
      Type[] streamParams = { typeHttpRawUploadedContent, typeof(int), typeof(int) }; 
      Type[] parameters = { typeof(string), typeof(string), typeHttpInputStream }; 

      // Create an HttpRawUploadedContent instance 
      object uploadedContent = typeHttpRawUploadedContent 
       .GetConstructor(BindingFlags.NonPublic | BindingFlags.Instance, null, uploadedParams, null) 
       .Invoke(new object[] { data.Length, data.Length }); 

      // Call the AddBytes method 
      typeHttpRawUploadedContent 
       .GetMethod("AddBytes", BindingFlags.NonPublic | BindingFlags.Instance) 
       .Invoke(uploadedContent, new object[] { data, 0, data.Length }); 

      // This is necessary if you will be using the returned content (ie to Save) 
      typeHttpRawUploadedContent 
       .GetMethod("DoneAddingBytes", BindingFlags.NonPublic | BindingFlags.Instance) 
       .Invoke(uploadedContent, null); 

      // Create an HttpInputStream instance 
      object stream = (Stream)typeHttpInputStream 
       .GetConstructor(BindingFlags.NonPublic | BindingFlags.Instance, null, streamParams, null) 
       .Invoke(new object[] { uploadedContent, 0, data.Length }); 

      // Create an HttpPostedFile instance 
      HttpPostedFile postedFile = (HttpPostedFile)typeof(HttpPostedFile) 
       .GetConstructor(BindingFlags.NonPublic | BindingFlags.Instance, null, parameters, null) 
       .Invoke(new object[] { filename, contentType, stream }); 

      return postedFile; 
     } 

     protected void UploadFile() 
     { 
      int successCount = 0; 
      HttpFileCollection MyFileCollection = Request.Files; 
      Response.Write("Total number file = " + dirs.Length + "<br/>"); 

      foreach (string dir in dirs) 
      { 

       byte[] fileData = System.IO.File.ReadAllBytes(dir); 
       string fileName = Path.GetFileName(dir); 
       flagUpdateFile = 1; 
       //Content Type is null 
       Session["File"] = ConstructHttpPostedFile(fileData, fileName); 

       //Token return from Google API 
       if (!string.IsNullOrEmpty(Request.QueryString["code"]) && flagUpdateFile == 1) 
       { 
        string code = Request.QueryString["code"]; 
        string json = GoogleConnect.PostFile(code, (HttpPostedFile)Session["File"], ""); 
        flagUpdateFile = 0; 
        System.IO.File.Delete(dir); 
        successCount++; 
       } 

       if (Request.QueryString["error"] == "access_denied") 
       { 
        ClientScript.RegisterClientScriptBlock(this.GetType(), "alert", "alert('Access denied.')", true); 
        Console.Write("Access denied,check your Authorized redirect URIs!"); 
       } 

       HttpContext.Current.Session.Remove("File"); 
       HttpContext.Current.Session.Abandon(); 

      } 
      Response.Write("Total file uploaded = " + successCount); 
      successCount = 0; 
      Response.Write("<span id='Label1' style='color:red'><br/>Sucess if the number is identical</span>"); 

     } 


    } 
} 

Answer 1

Acording到MSDN你可以设置它在web.config中为：

<configuration> 
    <runtime> 
    <gcAllowVeryLargeObjects enabled="true" /> 
    </runtime> 
</configuration> 

但它说：

true: Arrays greater than 2 GB in total size are enabled on 64-bit platforms. 

所以它不是在32位工作，这意味着你还需要运行在64位上的池。

裁判：http://msdn.microsoft.com/en-us/library/hh285054.aspx

Answer 2

我承认我不知道Google云端硬盘API，但你的代码似乎令人难以置信的复杂。你为什么要做反思，为什么每个文件？为什么要将整个文件加载到一个字节数组中，以便将它放入MemoryStream，从一开始就可以使用FileStream，它不会将整个文件复制到内存中？

我想说你需要简化你的代码。所有那些反思？写下你的想要写的实际的两行代码。然后使用文件流InputStream。

您似乎想要将所有文件放入一个请求中。该API似乎希望您在一个请求中适合单个文件。也许你应该这样做。